00000001:02000400:3.0F:1789127127.916404:0:3306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1789127146.032894:0:3526:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1789127147.803763:0:3589:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 719 MB/s 00000001:01000000:3.0:1789127148.055064:0:3589:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 756 MB/s 00000001:01000000:2.0:1789127148.304990:0:3589:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5219 MB/s 00000020:02000000:1.0F:1789127148.946184:0:3618:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_135_g8edbab4 00000400:02000000:2.0:1789127149.856085:0:3633:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.206.148@tcp [8/256/0/180] 00008000:02000000:0.0:1789127153.190741:0:3783:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789127211.360412:0:5749:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1789127224.106804:0:6499:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789127224.106814:0:6499:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:0.0:1789127224.106816:0:6499:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789127224.106947:0:6499:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ea0a073e 00000080:02000400:0.0:1789127224.106961:0:6499:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1789127224.118198:0:6499:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1789127224.118216:0:6499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789127224.118269:0:6499:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000d72a28f0) 00000020:00000080:0.0:1789127224.118293:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789127224.187284:0:6499:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1789127224.187404:0:6499:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1789127224.224320:0:6499:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789127224.224613:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789127224.224622:0:6499:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789127224.224634:0:6499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785d050 00000020:01000004:0.0:1789127224.224641:0:6499:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1789127224.224647:0:6499:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789127224.224652:0:6499:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ea0a073e from MGS 00000020:01000004:0.0:1789127224.224657:0:6499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789127224.224668:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000314a450c) 00000020:00000080:0.0:1789127224.224678:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789127224.224748:0:6499:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ea0a073e from MGS, refs=2 00080000:01000000:0.0:1789127224.224753:0:6499:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789127224.224757:0:6499:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785d05e 00000100:00100000:0.0:1789127224.224856:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789127224.226615:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789127224.226623:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789127224.237315:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789127224.237407:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789127224.240313:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127224.241659:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789127224.241668:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789127224.243427:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789127224.243613:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789127224.244226:0:6499:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789127224.244234:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1789127224.245268:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127224.245272:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127224.245274:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127224.247068:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127224.247076:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127224.247078:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127224.248080:0:6499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789127224.253064:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1789127224.498216:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2935 MB/s 00000001:01000000:3.0:1789127224.748020:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2559 MB/s 00000001:01000000:2.0:1789127224.998321:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 467 MB/s 00000001:01000000:1.0:1789127225.249286:0:6499:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 661 MB/s 00080000:10000000:0.0:1789127225.256709:0:6499:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:0.0:1789127225.267807:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1789127225.268537:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1789127225.268654:0:6499:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1789127225.268705:0:6499:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1789127225.268859:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789127225.268882:0:6499:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1789127225.269203:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127225.269351:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1789127225.269357:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789127225.272108:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789127225.272128:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:1.0:1789127225.272707:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127225.273619:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789127225.273629:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789127225.274582:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789127225.274608:0:6499:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.148@tcp' 00000020:01000004:3.0:1789127225.274610:0:6499:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789127225.274668:0:6499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.148@tcp (typ=mgc) 00000020:00000080:3.0:1789127225.274691:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.148@tcp (0000000032088d9e) 00000020:00000080:3.0:1789127225.274710:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789127225.274843:0:6499:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b3bd1df2@MGC192.168.206.148@tcp: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1789127225.275002:0:6499:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.148@tcp-0 is initialized 00000040:01000000:3.0:1789127225.275011:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789127225.279739:0:6520:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789127225.279803:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.148@tcp (uuid 2eb81216-4f2e-430c-a0f6-5094c3b40588) 00000100:00080000:1.0:1789127225.279814:0:6518:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1789127225.279830:0:6499:0:(genops.c:1385:class_connect()) connect: client 2eb81216-4f2e-430c-a0f6-5094c3b40588, cookie 0xd718aadfd785d06c 00000100:00080000:3.0:1789127225.279847:0:6499:0:(import.c:510:import_select_connection()) MGC192.168.206.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127225.279854:0:6499:0:(import.c:624:import_select_connection()) MGC192.168.206.148@tcp: import 00000000b3bd1df2 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789127225.279896:0:6499:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008cfc3632 x1876035789389952/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127225.279920:0:6499:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS 00000020:01000004:3.0:1789127225.279946:0:6499:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789127225.279952:0:6499:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789127225.279966:0:6499:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000002b22fdc5) 00000020:00000080:3.0:1789127225.279979:0:6499:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789127225.280003:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008cfc3632 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2eb81216-4f2e-430c-a0f6-5094c3b40588:3649:1876035789389952:0@lo:250: 00000100:00100000:1.0:1789127225.280068:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.281572:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789389952 00000100:00100000:2.0:1789127225.281590:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789389952 00000100:00100000:2.0:1789127225.281659:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127225.281669:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000258057d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3649:x1876035789389952:12345-0@lo:250: 00010000:00080000:2.0:1789127225.281705:0:6514:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 2eb81216-4f2e-430c-a0f6-5094c3b40588@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:2.0:1789127225.281879:0:6514:0:(genops.c:1385:class_connect()) connect: client 2eb81216-4f2e-430c-a0f6-5094c3b40588, cookie 0xd718aadfd785d07a 00000100:00080000:2.0:1789127225.282193:0:6514:0:(import.c:65:import_set_state_nolock()) 00000000e4148fed : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127225.282313:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000258057d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:3649:x1876035789389952:12345-0@lo:250: Request processed in 644us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127225.282322:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127225.282717:0:3649:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789127225.282728:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.148@tcp: connect to target with instance 0 00000100:00080000:0.0:1789127225.282736:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789127225.282742:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789127225.282746:0:3649:0:(import.c:65:import_set_state_nolock()) 00000000b3bd1df2 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789127225.282749:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789127225.282753:0:3649:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789127225.282758:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008cfc3632 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2eb81216-4f2e-430c-a0f6-5094c3b40588:3649:1876035789389952:0@lo:250: 00000100:00100000:3.0:1789127225.290185:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127225.290443:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789127225.290452:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789127225.292656:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789127225.292669:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789127225.297461:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789127225.297656:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789127225.299052:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127225.300301:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789127225.300309:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789127225.301480:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789127225.301492:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789127225.365357:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127225.366417:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789127225.366425:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789127225.370344:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789127225.370360:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789127225.375832:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127225.376084:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789127225.376091:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789127225.381635:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789127225.381653:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789127225.382506:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127225.382749:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789127225.382755:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789127225.383548:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789127225.383556:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789127225.384158:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127225.384352:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789127225.384358:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789127225.385136:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789127225.385150:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789127225.413239:0:6499:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127225.413502:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789127225.413588:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789127225.415968:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789127225.415987:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789127225.417719:0:6499:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789127225.417734:0:6499:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789127225.419459:0:6499:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789127225.419497:0:6499:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789127225.419505:0:6499:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789127225.420007:0:6499:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789127225.420067:0:6499:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.148@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1789127225.420073:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789127225.420080:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789127225.420081:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127225.420083:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127225.420083:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127225.420084:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127225.420085:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789127225.420087:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789127225.420088:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789127225.420090:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789127225.420091:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127225.420093:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789127225.420095:0:6499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1789127225.420097:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789127225.420098:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789127225.420098:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127225.420099:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127225.420100:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127225.420101:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127225.420101:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789127225.420102:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789127225.420103:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789127225.420103:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789127225.420104:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127225.420105:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789127225.420139:0:6499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789127225.420161:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789390080:0@lo:253: 00000100:00100000:2.0:1789127225.420261:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.420361:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000239b6638 going to sleep for 11 seconds 00000100:00100000:0.0:1789127225.420459:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789390080 00000100:00100000:0.0:1789127225.420468:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789390080 00000100:00100000:0.0:1789127225.420624:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127225.420635:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000436bce30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:6499:x1876035789390080:12345-0@lo:253: 20000000:01000000:0.0:1789127225.420690:0:6517:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789127225.420693:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1789127225.421030:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789127225.421093:0:6517:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789127225.421447:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127225.424323:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789127225.424991:0:6517:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789127225.424997:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789127225.425004:0:6517:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789127225.425008:0:6517:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789127225.425022:0:6517:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789127225.425247:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127225.425504:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789127225.425665:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789127225.425688:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789127225.425706:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789127225.425723:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789127225.425783:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789127225.425791:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789127225.425802:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789127225.425808:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789127225.425819:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789127225.425824:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789127225.425836:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789127225.425862:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789127225.425890:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789127225.425895:0:6517:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789127225.425902:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127225.425995:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789127225.426004:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789127225.426016:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789127225.426029:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789127225.426041:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789127225.426049:0:6517:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789127225.426070:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789127225.426077:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789127225.426087:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789127225.426100:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789127225.426114:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789127225.426122:0:6517:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789127225.426145:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789127225.426152:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789127225.426164:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789127225.426179:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789127225.426238:0:6517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789127225.426260:0:6517:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789127225.426268:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789127225.426842:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789127225.427681:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789127225.427710:0:6517:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.148@tcp for mdt 20000000:01000000:3.0:1789127225.427713:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789127225.427727:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789127225.427732:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789127225.427744:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789127225.427749:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:3.0:1789127225.427760:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789127225.427766:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789127225.427795:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789127225.427810:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789127225.427839:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789127225.427843:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789127225.427847:0:6517:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789127225.427921:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789127225.427924:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789127225.428811:0:6541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1789127225.430322:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1789127225.430351:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1789127225.430364:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1789127225.430377:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789127225.430379:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789127225.430896:0:6542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789127225.436707:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789127225.436764:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789127225.436779:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1789127225.436795:0:6517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789127225.436797:0:6517:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1789127225.436804:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789127225.436806:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789127225.436812:0:6517:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789127225.436821:0:6517:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1789127225.437649:0:6543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1789127225.439597:0:6517:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1789127225.452956:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1789127225.452995:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1789127225.453016:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1789127225.453053:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789127225.453079:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000d656c5c7/0xd718aadfd785d081 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.453098:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d656c5c7/0xd718aadfd785d081 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.453130:0:6517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d656c5c7/0xd718aadfd785d081 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.453137:0:6517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000d656c5c7/0xd718aadfd785d081 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.453143:0:6517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000d656c5c7/0xd718aadfd785d081 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.453150:0:6517:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000d656c5c7/0xd718aadfd785d081 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.453156:0:6517:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d656c5c7 already unused, calling callback (0000000040e5145c) 00010000:00010000:2.0:1789127225.453160:0:6517:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000d656c5c7/0xd718aadfd785d081 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.453169:0:6517:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000d656c5c7/0xd718aadfd785d081 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.453185:0:6517:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000d656c5c7/0xd718aadfd785d081 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.453194:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000d656c5c7/0xd718aadfd785d081 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.453200:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d656c5c7/0xd718aadfd785d081 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789127225.453219:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789127225.471710:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000436bce30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:6499:x1876035789390080:12345-0@lo:253: Request processed in 51066us (51438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.471731:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127225.472456:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789390080:0@lo:253: 10000000:01000000:2.0:1789127225.472499:0:6499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789127225.472503:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789127225.472505:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789127225.472507:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127225.472554:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1789127225.472555:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127225.472566:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127225.472567:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789127225.472569:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789127225.472570:0:6499:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789127225.472572:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127225.472574:0:6499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789127225.472622:0:6499:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ea0a073e from lustre-MDT0000 10000000:01000000:2.0:1789127225.472681:0:6499:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789127225.472684:0:6499:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789127225.472690:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9346b18f3490 10000000:01000000:2.0:1789127225.472695:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789127225.472706:0:6499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9346b18f3490 from 1 10000000:01000000:2.0:1789127225.472709:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789127225.472771:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.472783:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.472793:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127225.472813:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789390208:0@lo:101: 00000100:00100000:2.0:1789127225.472867:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.472937:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f023628 going to sleep for 11 seconds 00000100:00100000:1.0:1789127225.472997:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789390208 00000100:00100000:1.0:1789127225.473006:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789390208 00000100:00100000:1.0:1789127225.473069:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127225.473078:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f253ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:6499:x1876035789390208:12345-0@lo:101: 00010000:00010000:1.0:1789127225.473093:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127225.473108:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002df52a2b/0xd718aadfd785d08f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d088 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127225.473133:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002df52a2b/0xd718aadfd785d08f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d088 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127225.473143:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002df52a2b/0xd718aadfd785d08f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d088 expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127225.473153:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002df52a2b, rc 0) 00000100:00100000:1.0:1789127225.473206:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f253ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:6499:x1876035789390208:12345-0@lo:101: Request processed in 130us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127225.473213:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127225.473228:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789390208:0@lo:101: 00010000:00010000:0.0:1789127225.473241:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d08f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.473249:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d08f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127225.473327:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000929e76dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789390336:0@lo:501: 00000100:00100000:0.0:1789127225.473354:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127225.473377:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ec7a26e5 going to sleep for 11 seconds 00000100:00100000:1.0:1789127225.473413:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789390336 00000100:00100000:1.0:1789127225.473418:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789390336 00000100:00100000:1.0:1789127225.473501:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789127225.473535:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4f9c905 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:6499:x1876035789390336:12345-0@lo:501: 00000100:00100000:1.0:1789127225.473618:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4f9c905 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:6499:x1876035789390336:12345-0@lo:501: Request processed in 112us (264us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789127225.473625:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127225.473725:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000929e76dc pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789390336:0@lo:501: 10000000:01000000:3.0:1789127225.473777:0:6499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789127225.473804:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d08f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.473815:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d08f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127225.473826:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff934687bf9800 10000000:01000000:3.0:1789127225.473834:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789127225.473839:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff934687bf9800 10000000:01000000:3.0:1789127225.473842:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789127225.473845:0:6499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff934687bf9800 from 1 10000000:01000000:3.0:1789127225.473847:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789127225.473882:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000f80b2db5/0xd718aadfd785d096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.473907:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000f80b2db5/0xd718aadfd785d096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.473917:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000f80b2db5/0xd718aadfd785d096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127225.473935:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041f2c7e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789390464:0@lo:101: 00000100:00100000:3.0:1789127225.474022:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.482819:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c5970515 going to sleep for 11 seconds 00000100:00100000:0.0:1789127225.487170:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789390464 00000100:00100000:0.0:1789127225.487191:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789390464 00000100:00100000:0.0:1789127225.487268:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127225.487278:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097914a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:6499:x1876035789390464:12345-0@lo:101: 00010000:00010000:0.0:1789127225.487300:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127225.487327:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b03be21c/0xd718aadfd785d09d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d096 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.487371:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b03be21c/0xd718aadfd785d09d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d096 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.487383:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b03be21c/0xd718aadfd785d09d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d096 expref: 7 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.487393:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b03be21c, rc 0) 00000100:00100000:0.0:1789127225.488000:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097914a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+7:6499:x1876035789390464:12345-0@lo:101: Request processed in 723us (13977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.488010:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127225.493130:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041f2c7e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789390464:0@lo:101: 00010000:00010000:3.0:1789127225.493172:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000f80b2db5/0xd718aadfd785d096 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.493188:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000f80b2db5/0xd718aadfd785d096 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127225.493213:0:6499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789127225.493223:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000f80b2db5/0xd718aadfd785d096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.493230:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000f80b2db5/0xd718aadfd785d096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127225.493239:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789127225.493250:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789127225.493258:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff934687bf9800 10000000:01000000:3.0:1789127225.493261:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789127225.493264:0:6499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789127225.493285:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789127225.493327:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.493335:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.493345:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127225.493367:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041f2c7e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789390592:0@lo:101: 00000100:00100000:3.0:1789127225.493465:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.493541:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789390592 00000100:00100000:3.0:1789127225.493549:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789390592 00000100:00100000:3.0:1789127225.493598:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127225.493607:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f283fa9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+7:6499:x1876035789390592:12345-0@lo:101: 00010000:00010000:3.0:1789127225.493624:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127225.493637:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce6a1726/0xd718aadfd785d0ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d0a4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.493659:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce6a1726/0xd718aadfd785d0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d0a4 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.493669:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce6a1726/0xd718aadfd785d0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d0a4 expref: 8 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.493745:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce6a1726, rc 0) 00000100:00100000:3.0:1789127225.493779:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f283fa9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+8:6499:x1876035789390592:12345-0@lo:101: Request processed in 174us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127225.493787:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127225.493854:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c5970515 going to sleep for 11 seconds 00000100:00100000:3.0:1789127225.493868:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041f2c7e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789390592:0@lo:101: 00010000:00010000:3.0:1789127225.493876:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d0ab expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.493884:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d0ab expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127225.494238:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041f2c7e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789390720:0@lo:501: 00000100:00100000:3.0:1789127225.494267:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.494294:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789390720 00000100:00100000:3.0:1789127225.494299:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789390720 00000100:00100000:3.0:1789127225.494317:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127225.494323:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008488a597 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+8:6499:x1876035789390720:12345-0@lo:501: 00000100:00100000:3.0:1789127225.494684:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008488a597 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+9:6499:x1876035789390720:12345-0@lo:501: Request processed in 359us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127225.494691:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127225.494716:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c5970515 going to sleep for 11 seconds 00000100:00100000:3.0:1789127225.494729:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041f2c7e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789390720:0@lo:501: 00000100:00100000:3.0:1789127225.494756:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041f2c7e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789390848:0@lo:503: 00000100:00100000:3.0:1789127225.494800:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.494819:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789390848 00000100:00100000:3.0:1789127225.494824:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789390848 00000100:00100000:3.0:1789127225.494839:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127225.494844:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abdd1b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+9:6499:x1876035789390848:12345-0@lo:503: 00000100:00100000:3.0:1789127225.495875:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abdd1b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+9:6499:x1876035789390848:12345-0@lo:503: Request processed in 1027us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127225.495906:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127225.495970:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c5970515 going to sleep for 11 seconds 00000100:00100000:3.0:1789127225.495985:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041f2c7e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789390848:0@lo:503: 00000100:00100000:3.0:1789127225.497733:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041f2c7e7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:6544:1876035789390976:0@lo:502: 00000100:00100000:3.0:1789127225.497853:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.498572:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789390976 00000100:00100000:3.0:1789127225.498583:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789390976 00000100:00100000:3.0:1789127225.498631:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127225.498640:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e474af5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+9:6544:x1876035789390976:12345-0@lo:502: 00000100:00100000:3.0:1789127225.498786:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e474af5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+9:6544:x1876035789390976:12345-0@lo:502: Request processed in 146us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127225.498794:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127225.498858:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set 0000000051ba5186 going to sleep for 11 seconds 00000100:00100000:3.0:1789127225.498880:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041f2c7e7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:6544:1876035789390976:0@lo:502: 00000020:01000000:3.0:1789127225.499024:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127225.499038:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127225.499041:0:6544:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789127225.499048:0:6544:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789127225.499051:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127225.499067:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003ddaa302) 00000020:00000080:3.0:1789127225.499088:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789127225.499094:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789127225.499200:0:6544:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789127225.499209:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785d0b9 00000020:00000080:3.0:1789127225.504789:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789127225.504806:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127225.504816:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127225.504825:0:6544:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789127225.504829:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127225.504837:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127225.504839:0:6544:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789127225.504843:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127225.504859:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000007de33f3e) 00000020:00000080:3.0:1789127225.504885:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789127225.505131:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789127225.505134:0:6544:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789127225.505137:0:6544:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789127225.505145:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789127225.505233:0:6544:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ea0a073e from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789127225.505258:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000e5247600) 00000020:00000080:3.0:1789127225.505269:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789127225.505351:0:6544:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789127225.505359:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd718aadfd785d0ce 00000020:00000080:3.0:1789127225.505532:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789127225.505539:0:6544:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789127225.505544:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd718aadfd785d0d5 00080000:01000000:3.0:1789127225.505551:0:6544:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789127225.505567:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785d0dc 00080000:10000000:3.0:1789127225.513654:0:6544:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789127225.513993:0:6544:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789127225.528185:0:6544:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1789127225.688095:0:6544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1789127225.688906:0:6544:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1789127225.702404:0:6544:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789127225.703720:0:6544:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789127225.710363:0:6544:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b743c2fb) 00000020:00000080:2.0:1789127225.710399:0:6544:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789127225.710586:0:6544:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789127225.710603:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785d0ea 00000020:00000080:3.0:1789127225.713042:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789127225.714008:0:6544:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1789127225.716960:0:6544:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:3.0:1789127225.722548:0:6544:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1789127225.727406:0:6544:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1789127225.730883:0:6544:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1789127225.732707:0:6544:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1789127225.735369:0:6544:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd718aadfd785d0f1 00000020:00000080:0.0:1789127225.736201:0:6544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789127225.736215:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127225.736298:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127225.736301:0:6544:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789127225.736305:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127225.736310:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127225.736311:0:6544:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789127225.736314:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789127225.736315:0:6544:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789127225.736318:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127225.736320:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127225.736321:0:6544:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789127225.736323:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127225.736328:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127225.736329:0:6544:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789127225.736334:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789127225.736568:0:6544:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1789127225.736642:0:6544:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059aed028 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:6544:1876035789391104:0@lo:502: 00000100:00100000:0.0:1789127225.736749:0:6544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.736779:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789391104 00000100:00100000:3.0:1789127225.736789:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789391104 00000100:00100000:0.0:1789127225.736816:0:6544:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd5b6b8c going to sleep for 11 seconds 00000100:00100000:3.0:1789127225.736837:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127225.736846:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070b9e7de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+9:6544:x1876035789391104:12345-0@lo:502: 00000100:00100000:3.0:1789127225.736990:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070b9e7de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+9:6544:x1876035789391104:12345-0@lo:502: Request processed in 145us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127225.737004:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127225.737122:0:6544:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059aed028 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:6544:1876035789391104:0@lo:502: 00000020:01000000:0.0:1789127225.737152:0:6544:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127225.737159:0:6544:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127225.737160:0:6544:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1789127225.737164:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789127225.737245:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789127225.737268:0:6499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789127225.737294:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d0ab expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.737305:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d0ab expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127225.737313:0:6499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff934687bf9800 from 1 10000000:01000000:3.0:1789127225.737316:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789127225.737347:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.737353:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.737361:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127225.737373:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000041f2c7e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789391232:0@lo:101: 00000100:00100000:3.0:1789127225.737404:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127225.737422:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 0000000051ba5186 going to sleep for 11 seconds 00000100:00100000:0.0:1789127225.737593:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789391232 00000100:00100000:0.0:1789127225.737598:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789391232 00000100:00100000:0.0:1789127225.737627:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127225.737634:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009451e747 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+9:6499:x1876035789391232:12345-0@lo:101: 00010000:00010000:0.0:1789127225.737644:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127225.737658:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d44a44b3/0xd718aadfd785d0ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d0f8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.737691:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d44a44b3/0xd718aadfd785d0ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d0f8 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.737701:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d44a44b3/0xd718aadfd785d0ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d0f8 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.737710:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d44a44b3, rc 0) 00000100:00100000:0.0:1789127225.737758:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009451e747 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+10:6499:x1876035789391232:12345-0@lo:101: Request processed in 124us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.737764:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127225.737961:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000041f2c7e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789391232:0@lo:101: 00010000:00010000:2.0:1789127225.737974:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d0ff expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.737983:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d0ff expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127225.738793:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789391360:0@lo:256: 00000100:00100000:2.0:1789127225.738867:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.738959:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a32f2e1 going to sleep for 11 seconds 00000100:00100000:0.0:1789127225.739017:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789391360 00000100:00100000:0.0:1789127225.739023:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789391360 00000100:00100000:0.0:1789127225.739072:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127225.739080:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075b3dc96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+10:6499:x1876035789391360:12345-0@lo:256: 20000000:01000000:0.0:1789127225.739097:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789127225.739104:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789127225.739343:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075b3dc96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+10:6499:x1876035789391360:12345-0@lo:256: Request processed in 263us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.739352:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127225.739407:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789391360:0@lo:256: 10000000:01000000:2.0:1789127225.740100:0:6499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789127225.740166:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d0ff expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.740178:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d0ff expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127225.740186:0:6499:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934687bf9800 from 1 10000000:01000000:2.0:1789127225.740189:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127225.740226:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.740246:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.740256:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127225.740272:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789391488:0@lo:101: 00000100:00100000:2.0:1789127225.740314:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.740337:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a32f2e1 going to sleep for 11 seconds 00000100:00100000:3.0:1789127225.740603:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789391488 00000100:00100000:3.0:1789127225.740611:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789391488 00000100:00100000:3.0:1789127225.740661:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127225.740670:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007eef4478 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+10:6499:x1876035789391488:12345-0@lo:101: 00010000:00010000:3.0:1789127225.740683:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127225.740698:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b4ddaf5d/0xd718aadfd785d10d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d106 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.740733:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b4ddaf5d/0xd718aadfd785d10d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d106 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.740744:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b4ddaf5d/0xd718aadfd785d10d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d106 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127225.740752:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b4ddaf5d, rc 0) 00000100:00100000:3.0:1789127225.740804:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007eef4478 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+11:6499:x1876035789391488:12345-0@lo:101: Request processed in 130us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127225.740812:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789127225.740984:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789391488:0@lo:101: 00010000:00010000:2.0:1789127225.740998:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d10d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.741007:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d10d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127225.741068:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789391616:0@lo:501: 00000100:00100000:2.0:1789127225.741095:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.741127:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a32f2e1 going to sleep for 11 seconds 00000100:00100000:0.0:1789127225.741182:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789391616 00000100:00100000:0.0:1789127225.741186:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789391616 00000100:00100000:0.0:1789127225.741256:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127225.741263:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0ec4ddc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+11:6499:x1876035789391616:12345-0@lo:501: 00000100:00100000:0.0:1789127225.741474:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0ec4ddc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+11:6499:x1876035789391616:12345-0@lo:501: Request processed in 212us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.741482:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127225.741550:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789391616:0@lo:501: 00000100:00100000:2.0:1789127225.741595:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789391744:0@lo:503: 00000100:00100000:2.0:1789127225.741631:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.741919:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a32f2e1 going to sleep for 11 seconds 00000100:00100000:1.0:1789127225.741957:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789391744 00000100:00100000:1.0:1789127225.741962:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789391744 00000100:00100000:1.0:1789127225.741988:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789127225.741995:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3544da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+11:6499:x1876035789391744:12345-0@lo:503: 00000040:00080000:1.0:1789127225.742030:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127225.742117:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3544da3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+11:6499:x1876035789391744:12345-0@lo:503: Request processed in 123us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127225.742123:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127225.742293:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789391744:0@lo:503: 00000040:00080000:1.0:1789127225.743363:0:6548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789127225.743807:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789127225.743841:0:6499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127225.743860:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d10d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.743873:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d10d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127225.743941:0:6499:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789127225.743944:0:6499:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff934687bf9800 10000000:01000000:2.0:1789127225.743947:0:6499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff934687bf9800 10000000:01000000:2.0:1789127225.743952:0:6499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789127225.743959:0:6499:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff934687bf9800 from 1 10000000:01000000:2.0:1789127225.743962:0:6499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789127225.743996:0:6499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.744004:0:6499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.744015:0:6499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127225.744033:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789391872:0@lo:101: 00000100:00100000:2.0:1789127225.744101:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.744143:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a32f2e1 going to sleep for 11 seconds 00000100:00100000:1.0:1789127225.744290:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789391872 00000100:00100000:1.0:1789127225.744298:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789391872 00000100:00100000:1.0:1789127225.744374:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789127225.744383:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070cca5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+11:6499:x1876035789391872:12345-0@lo:101: 00010000:00010000:1.0:1789127225.744403:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127225.744417:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e058d006/0xd718aadfd785d11b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d114 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127225.744465:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e058d006/0xd718aadfd785d11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d114 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127225.744485:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e058d006/0xd718aadfd785d11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d114 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127225.744494:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e058d006, rc 0) 00000100:00100000:1.0:1789127225.744559:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070cca5fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:6499:x1876035789391872:12345-0@lo:101: Request processed in 177us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127225.744567:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789127225.744643:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789391872:0@lo:101: 00010000:00010000:2.0:1789127225.744657:0:6499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d11b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.744665:0:6499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d11b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127225.744739:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789392000:0@lo:501: 00000100:00100000:2.0:1789127225.744765:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.745033:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a32f2e1 going to sleep for 11 seconds 00000100:00100000:0.0:1789127225.745126:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789392000 00000100:00100000:0.0:1789127225.745138:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789392000 00000100:00100000:0.0:1789127225.745176:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127225.745184:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2b3b099 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:6499:x1876035789392000:12345-0@lo:501: 00000100:00100000:0.0:1789127225.745323:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2b3b099 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:6499:x1876035789392000:12345-0@lo:501: Request processed in 140us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.745331:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789127225.745407:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789392000:0@lo:501: 00000100:00100000:2.0:1789127225.745454:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789392128:0@lo:503: 00000100:00100000:2.0:1789127225.745495:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.745553:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a32f2e1 going to sleep for 11 seconds 00000100:00100000:0.0:1789127225.745662:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789392128 00000100:00100000:0.0:1789127225.745667:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789392128 00000100:00100000:0.0:1789127225.745686:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789127225.745691:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034a63101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:6499:x1876035789392128:12345-0@lo:503: 00000100:00100000:0.0:1789127225.745776:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034a63101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:6499:x1876035789392128:12345-0@lo:503: Request processed in 84us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.745782:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127225.745934:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789392128:0@lo:503: 00000100:00100000:2.0:1789127225.746394:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:6549:1876035789392256:0@lo:502: 00000100:00100000:2.0:1789127225.746451:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.746481:0:6549:0:(client.c:2715:ptlrpc_set_wait()) set 000000006f023628 going to sleep for 11 seconds 00000100:00100000:1.0:1789127225.746525:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789392256 00000100:00100000:1.0:1789127225.746531:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789392256 00000100:00100000:1.0:1789127225.746564:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789127225.746571:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005089210d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:6549:x1876035789392256:12345-0@lo:502: 00000100:00100000:1.0:1789127225.746677:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005089210d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:6549:x1876035789392256:12345-0@lo:502: Request processed in 107us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127225.746684:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789127225.748596:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:6549:1876035789392256:0@lo:502: 00000020:01000004:2.0:1789127225.748700:0:6549:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789127225.748721:0:6549:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b41437aa) 00000020:00000080:2.0:1789127225.748745:0:6549:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789127225.748877:0:6549:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ea0a073e from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789127225.748882:0:6549:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ea0a073e from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789127225.748885:0:6549:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ea0a073e 4 00010000:00080000:2.0:1789127225.748918:0:6549:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001560fa6b@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:2.0:1789127225.751790:0:6549:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789127225.752104:0:6549:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789127225.752161:0:6549:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789127225.752176:0:6549:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd718aadfd785d129 00000100:00080000:2.0:1789127225.752188:0:6549:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127225.752194:0:6549:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000001560fa6b using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789127225.752242:0:6549:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000508c153e x1876035789392384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127225.752271:0:6549:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789127225.752350:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876035789392384:0@lo:38: 00000100:00100000:0.0:1789127225.752648:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.752884:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789392384 00000100:00100000:2.0:1789127225.752894:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789392384 00000100:00100000:2.0:1789127225.752936:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127225.752944:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059aed028 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1876035789392384:12345-0@lo:38: 00000100:00100000:2.0:1789127225.753002:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059aed028 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1876035789392384:12345-0@lo:38: Request processed in 58us (355us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789127225.753008:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127225.753084:0:6549:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4b6354c pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:6549:1876035789392512:0@lo:502: 00000100:00100000:2.0:1789127225.753127:0:6549:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127225.753140:0:6549:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d57c86e8 going to sleep for 11 seconds 00000100:00100000:0.0:1789127225.753242:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789127225.753250:0:3649:0:(import.c:65:import_set_state_nolock()) 000000001560fa6b lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789127225.753253:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789127225.753257:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876035789392384:0@lo:38: 00000100:00100000:0.0:1789127225.753284:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789392512 00000100:00100000:0.0:1789127225.753288:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789392512 00000100:00100000:0.0:1789127225.753322:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127225.753328:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b0e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:6549:x1876035789392512:12345-0@lo:502: 00000100:00100000:0.0:1789127225.753711:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b0e3a83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:6549:x1876035789392512:12345-0@lo:502: Request processed in 382us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.753719:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789127225.753849:0:6549:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4b6354c pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:6549:1876035789392512:0@lo:502: 00000040:00080000:2.0:1789127225.753875:0:6549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789127225.753990:0:6499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789127225.754024:0:6499:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789127225.754077:0:6499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d11b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.754087:0:6499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d11b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789127225.754133:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789127225.754136:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789127225.754137:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127225.754139:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127225.754140:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127225.754142:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127225.754143:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127225.754144:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789127225.754146:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789127225.754148:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789127225.754149:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127225.754163:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789127225.754167:0:6499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789127225.754170:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789127225.754171:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789127225.754172:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127225.754173:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127225.754174:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127225.754175:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127225.754176:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127225.754177:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789127225.754178:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789127225.754179:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789127225.754180:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127225.754181:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789127225.754198:0:6499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789127225.754207:0:6499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d22b06e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789392640:0@lo:253: 00000100:00100000:0.0:1789127225.754243:0:6499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127225.754271:0:6499:0:(client.c:2715:ptlrpc_set_wait()) set 00000000239b6638 going to sleep for 11 seconds 00000100:00100000:3.0:1789127225.754627:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789392640 00000100:00100000:3.0:1789127225.754703:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789392640 00000100:00100000:3.0:1789127225.754747:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789127225.754755:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001970e60a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:6499:x1876035789392640:12345-0@lo:253: 20000000:01000000:3.0:1789127225.754783:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789127225.754798:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789127225.763713:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789127225.763735:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1789127225.763892:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789127225.763897:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789127225.763922:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.763945:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d44a44b3/0xd718aadfd785d0ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d0f8 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.763953:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.764010:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d44a44b3/0xd718aadfd785d0ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d0f8 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.764030:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d44a44b3/0xd718aadfd785d0ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d0f8 expref: 12 pid: 6517 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127225.764044:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b517e5c4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1876035789392768:0@lo:104: 00000100:00100000:0.0:1789127225.764128:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127225.764193:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set 000000006e3cd2d3 going to sleep for 11 seconds 00000100:00100000:2.0:1789127225.764218:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789392768 00000100:00100000:2.0:1789127225.764235:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789392768 00000100:00100000:2.0:1789127225.764295:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127225.764304:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8766d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6538:x1876035789392768:12345-0@lo:104: 00010000:00010000:2.0:1789127225.764318:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d0ff expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127225.764366:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127225.764367:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001970e60a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:6499:x1876035789392640:12345-0@lo:253: Request processed in 9612us (10122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127225.764370:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8766d96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6538:x1876035789392768:12345-0@lo:104: Request processed in 69us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127225.764376:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789127225.764376:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127225.764548:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b517e5c4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1876035789392768:0@lo:104: 00010000:00010000:0.0:1789127225.764568:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127225.764706:0:6499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d22b06e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:6499:1876035789392640:0@lo:253: 10000000:01000000:1.0:1789127225.764718:0:6499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789127225.764721:0:6499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789127225.764723:0:6499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789127225.764724:0:6499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127225.764725:0:6499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127225.764726:0:6499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127225.764728:0:6499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127225.764729:0:6499:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127225.764730:0:6499:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789127225.764731:0:6499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789127225.764733:0:6499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789127225.764734:0:6499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127225.764735:0:6499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789127225.764746:0:6499:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:0.0:1789127225.766646:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127225.766658:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d0ff expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.766672:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000de5abadb already unused, calling callback (000000001e5df574) 10000000:00010000:0.0:1789127225.766675:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d0ff expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.766712:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d0ff expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127225.766720:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d0ff expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127225.766725:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127225.766823:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d0ff expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.766831:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127225.766864:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d0ff expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.766871:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 00000000de5abadb/0xd718aadfd785d0f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d0ff expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.766891:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127225.766893:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127225.766895:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127225.767068:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b517e5c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789392896:0@lo:103: 00000100:00100000:3.0:1789127225.767140:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127225.767301:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789392896 00000100:00100000:0.0:1789127225.767309:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789392896 00010000:00010000:0.0:1789127225.767337:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d44a44b3/0xd718aadfd785d0ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d0f8 expref: 12 pid: 6517 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127225.767376:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127225.767387:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000885bcf2e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:3651:x1876035789392896:12345-0@lo:103: 00010000:00010000:0.0:1789127225.767400:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127225.767404:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d44a44b3/0xd718aadfd785d0ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d0f8 expref: 12 pid: 6517 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.767422:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d44a44b3/0xd718aadfd785d0ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d0f8 expref: 12 pid: 6517 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.767446:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d44a44b3/0xd718aadfd785d0ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d0f8 expref: 12 pid: 6517 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.767463:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.767471:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789127225.767488:0:6507:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003590864s 00010000:00010000:0.0:1789127225.767492:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.767499:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.767504:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.767539:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.767545:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002e84ddcc already unused, calling callback (0000000040e5145c) 00010000:00010000:0.0:1789127225.767548:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.767556:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.767578:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.767588:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127225.767629:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000885bcf2e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+11:3651:x1876035789392896:12345-0@lo:103: Request processed in 245us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127225.767649:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127225.767689:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b517e5c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789392896:0@lo:103: 00010000:00010000:0.0:1789127225.767714:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.767722:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127225.767728:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002e84ddcc/0xd718aadfd785d130 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1789127225.778650:0:6499:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1789127225.778950:0:6499:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789127225.779176:0:6499:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1789127225.779710:0:6499:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789127225.780130:0:6499:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1789127225.780375:0:6499:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1789127225.781811:0:6499:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1789127225.781992:0:6499:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789127225.782180:0:6499:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1789127225.782910:0:6499:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1789127225.783177:0:6499:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1789127225.783338:0:6499:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1789127225.787415:0:6499:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789127225.797639:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789127225.797958:0:6555:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1789127225.799583:0:6554:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789127225.799591:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789127225.800145:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789127225.800306:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789127225.801106:0:6499:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:00080000:1.0:1789127225.804046:0:6555:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789127225.804815:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789127225.811166:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127225.812362:0:6499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789127225.812690:0:6555:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789127225.812758:0:6555:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789127225.812764:0:6555:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1789127225.813818:0:6499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789127225.813868:0:6499:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1789127225.814139:0:6499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1789127225.814741:0:6499:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:3.0:1789127225.815871:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789127225.816038:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789127225.816204:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789127225.816415:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789127225.816922:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789127225.817061:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789127225.817235:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789127225.817375:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789127225.817578:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789127225.817737:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789127225.817901:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789127225.818037:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789127225.818173:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789127225.818306:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789127225.818483:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789127225.818811:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1789127225.819162:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1789127225.819285:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1789127225.821186:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1789127225.821736:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1789127225.821884:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1789127225.822042:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1789127225.822185:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1789127225.822722:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1789127225.822891:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1789127225.823042:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1789127225.823178:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1789127225.823333:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1789127225.823482:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1789127225.823675:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1789127225.824120:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1789127225.824288:0:6499:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1789127225.824796:0:6499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:3.0:1789127225.830890:0:6499:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789127225.830944:0:6499:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4b241c6b988 00100000:10000000:3.0:1789127225.830954:0:6499:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789127225.832320:0:6499:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789127225.832342:0:6499:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789127225.832365:0:6499:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789127225.832383:0:6499:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1789127225.833779:0:6499:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127225.834003:0:6499:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789127226.296098:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127227.319757:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127228.345381:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127229.368051:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127230.392156:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789127230.480890:0:6800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1789127230.779928:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789127230.779936:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789127230.779939:0:37:0:(import.c:65:import_set_state_nolock()) 000000001560fa6b lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127230.779950:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000001560fa6b using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789127230.779972:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c2b0d040 x1876035789393152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127230.779994:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077ef1fba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789393024:0@lo:400: 00000100:00100000:2.0:1789127230.780076:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127230.780141:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789393024 00000100:00100000:2.0:1789127230.780148:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789393024 00000100:00100000:2.0:1789127230.780188:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127230.780198:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcc984f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+11:3652:x1876035789393024:12345-0@lo:400: 00000100:00100000:2.0:1789127230.780248:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcc984f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+11:3652:x1876035789393024:12345-0@lo:400: Request processed in 52us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127230.780256:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127230.780300:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077ef1fba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789393024:0@lo:400: 00000100:00100000:0.0:1789127230.782012:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c2b0d040 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876035789393152:0@lo:38: 00000100:00100000:0.0:1789127230.782067:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127230.782120:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789393152 00000100:00100000:2.0:1789127230.782127:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789393152 00000100:00100000:2.0:1789127230.782162:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127230.782168:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097f5d0d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1876035789393152:12345-0@lo:38: 00010000:00080000:2.0:1789127230.782193:0:6524:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:2.0:1789127230.782227:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd718aadfd785d137 00000004:00100000:2.0:1789127230.782268:0:6524:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789127230.782422:0:6524:0:(import.c:65:import_set_state_nolock()) 00000000380311af : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127230.782483:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097f5d0d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876035789393152:12345-0@lo:38: Request processed in 313us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127230.782490:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789127230.782557:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c2b0d040 x1876035789393152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789127230.782584:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789127230.782592:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789127230.782596:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789127230.782598:0:3649:0:(import.c:65:import_set_state_nolock()) 000000001560fa6b lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789127230.782603:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c2b0d040 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876035789393152:0@lo:38: 00010000:00010000:1.0:1789127231.415797:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789127231.693993:0:6852:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127231.695232:0:6852:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:0.0:1789127232.314974:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789127232.314988:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff934687bf9800 from 3 10000000:01000000:0.0:1789127232.314993:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127232.315035:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.315045:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.315055:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127232.315078:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b517e5c4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789393280:0@lo:101: 00000100:00100000:0.0:1789127232.315142:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127232.315191:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b090b83c going to sleep for 11 seconds 00000100:00100000:3.0:1789127232.315263:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789393280 00000100:00100000:3.0:1789127232.315271:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789393280 00000100:00100000:3.0:1789127232.315326:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789127232.315344:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008203c302 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+11:6520:x1876035789393280:12345-0@lo:101: 00010000:00010000:3.0:1789127232.315357:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127232.315370:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000128b6a2e/0xd718aadfd785d145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d13e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.315417:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000128b6a2e/0xd718aadfd785d145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d13e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.315427:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000128b6a2e/0xd718aadfd785d145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d13e expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127232.315437:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000128b6a2e, rc 0) 00000100:00100000:3.0:1789127232.315489:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008203c302 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:6520:x1876035789393280:12345-0@lo:101: Request processed in 155us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127232.315495:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789127232.315707:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b517e5c4 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789393280:0@lo:101: 00010000:00010000:1.0:1789127232.315721:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d145 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.315729:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d145 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127232.315785:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a594a0eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789393408:0@lo:256: 00000100:00100000:1.0:1789127232.315818:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127232.315847:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a84e6849 going to sleep for 11 seconds 00000100:00100000:0.0:1789127232.315887:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789393408 00000100:00100000:0.0:1789127232.315892:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789393408 00000100:00100000:0.0:1789127232.315923:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789127232.315930:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000082d5923 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:6520:x1876035789393408:12345-0@lo:256: 20000000:01000000:0.0:1789127232.315943:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789127232.315958:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789127232.315961:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789127232.316042:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000082d5923 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:6520:x1876035789393408:12345-0@lo:256: Request processed in 113us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127232.316049:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789127232.316102:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a594a0eb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789393408:0@lo:256: 10000000:01000000:1.0:1789127232.316142:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789127232.316147:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d145 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127232.316154:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d145 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127232.441249:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127233.463823:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127234.490008:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789127234.782754:0:6953:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127234.782921:0:6953:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789127235.523054:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127235.905112:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127235.905142:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789393536:0@lo:400: 00000100:00100000:0.0:1789127235.905440:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127235.905505:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789393664:0@lo:400: 00000100:00100000:0.0:1789127235.905551:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127235.905601:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789393664 00000100:00100000:0.0:1789127235.905610:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789393664 00000100:00100000:0.0:1789127235.905662:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127235.905670:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e858080 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789393664:12345-0@lo:400: 00000100:00100000:0.0:1789127235.905722:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e858080 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789393664:12345-0@lo:400: Request processed in 54us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127235.905729:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789127235.905784:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000e53adca7 x1876035789393664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127235.905797:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789393664:0@lo:400: 00000100:00100000:2.0:1789127235.905960:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789393536 00000100:00100000:2.0:1789127235.905964:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789393536 00000100:00100000:2.0:1789127235.906002:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789127235.906008:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000033eb816 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:3652:x1876035789393536:12345-0@lo:400: 00000100:00100000:2.0:1789127235.906043:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000033eb816 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:3652:x1876035789393536:12345-0@lo:400: Request processed in 36us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127235.906049:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789127235.906284:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789393536:0@lo:400: 00010000:00010000:3.0:1789127236.536794:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127237.560712:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127238.585652:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127239.612130:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127240.636198:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127241.016089:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127241.016112:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf3d5000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789393792:0@lo:400: 00000100:00100000:2.0:1789127241.016185:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127241.016236:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000002aec682 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789393920:0@lo:400: 00000100:00100000:2.0:1789127241.016280:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127241.016322:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789393792 00000100:00100000:2.0:1789127241.016329:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789393792 00000100:00100000:2.0:1789127241.016720:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789127241.016730:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049fa53b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:3650:x1876035789393792:12345-0@lo:400: 00000100:00100000:2.0:1789127241.016783:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049fa53b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:3650:x1876035789393792:12345-0@lo:400: Request processed in 55us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127241.016790:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789127241.016822:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789393920 00000100:00100000:2.0:1789127241.016833:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789393920 00000100:00100000:2.0:1789127241.016863:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127241.016868:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c2ed448 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789393920:12345-0@lo:400: 00000100:00100000:2.0:1789127241.016906:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c2ed448 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789393920:12345-0@lo:400: Request processed in 38us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127241.016912:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789127241.016960:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000002aec682 x1876035789393920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127241.016974:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000002aec682 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789393920:0@lo:400: 00000100:00100000:2.0:1789127241.017000:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf3d5000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789393792:0@lo:400: 00010000:00010000:1.0:1789127241.657121:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127242.679639:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127243.704697:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127244.734015:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127245.770100:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127246.135799:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005870bbc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789394048:0@lo:400: 00000100:00100000:1.0:1789127246.135871:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127246.135958:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b97942b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789394176:0@lo:400: 00000100:00100000:1.0:1789127246.135992:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127246.136029:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789394048 00000100:00100000:1.0:1789127246.136036:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789394048 00000100:00100000:1.0:1789127246.136077:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789127246.136084:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c241e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:3653:x1876035789394048:12345-0@lo:400: 00000100:00100000:1.0:1789127246.136132:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c241e55 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:3653:x1876035789394048:12345-0@lo:400: Request processed in 48us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127246.136139:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789127246.136183:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789394176 00000100:00100000:1.0:1789127246.136187:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789394176 00000100:00100000:1.0:1789127246.136215:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127246.136220:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbaff53a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789394176:12345-0@lo:400: 00000100:00100000:1.0:1789127246.136252:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbaff53a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789394176:12345-0@lo:400: Request processed in 32us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127246.136258:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789127246.136295:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007b97942b x1876035789394176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127246.136310:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b97942b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789394176:0@lo:400: 00000100:00100000:1.0:1789127246.136351:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005870bbc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789394048:0@lo:400: 00010000:00010000:0.0:1789127246.778545:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789127247.419191:0:7452:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789127247.419196:0:7452:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1789127247.419197:0:7452:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1789127247.420923:0:7452:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000e803766 00000020:01000004:1.0:1789127247.420942:0:7452:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1789127247.420953:0:7452:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789127247.420992:0:7452:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (00000000ec60be18) 00000020:00000080:1.0:1789127247.421009:0:7452:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789127247.494645:0:7452:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:1.0:1789127247.494704:0:7452:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1789127247.522359:0:7452:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789127247.523716:0:7452:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789127247.523730:0:7452:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789127247.523740:0:7452:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd718aadfd785d153 00000020:01000004:0.0:1789127247.523747:0:7452:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789127247.523768:0:7452:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789127247.523770:0:7452:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789127247.523785:0:7452:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789127247.523816:0:7452:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789127247.523820:0:7452:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789127247.547658:0:7452:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789127247.547696:0:7452:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.148@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1789127247.547701:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789127247.547702:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789127247.547703:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127247.547705:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127247.547706:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127247.547707:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127247.547708:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127247.547709:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789127247.547711:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789127247.547712:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127247.547713:0:7452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789127247.547716:0:7452:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1789127247.547718:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789127247.547720:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789127247.547721:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127247.547721:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127247.547722:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127247.547723:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127247.547724:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127247.547725:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789127247.547726:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789127247.547727:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127247.547728:0:7452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789127247.547755:0:7452:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789127247.547773:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a733cab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789394304:0@lo:253: 00000100:00100000:0.0:1789127247.547842:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127247.547970:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789394304 00000100:00100000:2.0:1789127247.547978:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789394304 00000100:00100000:0.0:1789127247.548173:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000003dcec276 going to sleep for 11 seconds 00000100:00100000:2.0:1789127247.553999:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789127247.554020:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013545f43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:7452:x1876035789394304:12345-0@lo:253: 20000000:01000000:2.0:1789127247.554058:0:6514:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789127247.554064:0:6514:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:2.0:1789127247.554069:0:6514:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:2.0:1789127247.554072:0:6514:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:2.0:1789127247.554116:0:6514:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:2.0:1789127247.554642:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127247.554812:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789127247.554827:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789127247.555068:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:2.0:1789127247.555090:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:2.0:1789127247.555104:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:2.0:1789127247.555156:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:2.0:1789127247.555172:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:2.0:1789127247.555191:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:2.0:1789127247.555197:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:2.0:1789127247.555210:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:2.0:1789127247.555215:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:2.0:1789127247.555227:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:2.0:1789127247.555242:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1789127247.555485:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1789127247.555495:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:2.0:1789127247.555546:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1789127247.555554:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789127247.556177:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1789127247.556192:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:2.0:1789127247.556212:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1789127247.556219:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789127247.556538:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1789127247.556561:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1789127247.556659:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1789127247.556774:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1789127247.556785:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1789127247.556800:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1789127247.556816:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1789127247.556834:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1789127247.556841:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1789127247.556854:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1789127247.556875:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1789127247.556881:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1789127247.556902:0:6514:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789127247.556909:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1789127247.559137:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1789127247.559378:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789127247.559404:0:6514:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.148@tcp for mdt 20000000:01000000:3.0:1789127247.559406:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789127247.559422:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789127247.559429:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789127247.559443:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789127247.559448:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:3.0:1789127247.559463:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789127247.559470:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1789127247.559498:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1789127247.559549:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1789127247.559606:0:6514:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1789127247.559615:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1789127247.562994:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1789127247.563254:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1789127247.563279:0:6514:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.206.148@tcp for mdt 20000000:01000000:3.0:1789127247.563282:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789127247.563298:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1789127247.563333:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789127247.563352:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1789127247.563357:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:3.0:1789127247.563369:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1789127247.563376:0:6514:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1789127247.563388:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1789127247.563401:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1789127247.563420:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789127247.563423:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789127247.563426:0:6514:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789127247.563483:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789127247.563486:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789127247.569387:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789127247.569451:0:7460:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789127247.569465:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1789127247.569730:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789127247.569754:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789127247.569771:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1789127247.569779:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789127247.569782:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789127247.570190:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1789127247.570207:0:7461:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1789127247.570220:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789127247.570361:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789127247.570380:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789127247.570404:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789127247.570415:0:6514:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789127247.570417:0:6514:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789127247.570723:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789127247.570740:0:7462:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789127247.570754:0:7462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1789127247.570867:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1789127247.570885:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1789127247.570915:0:6514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1789127247.570932:0:6514:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789127247.570934:0:6514:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1789127247.570939:0:6514:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1789127247.570945:0:6514:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789127247.571285:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1789127247.571382:0:6514:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789127247.590829:0:6514:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789127247.590917:0:6514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.590950:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002df52a2b/0xd718aadfd785d08f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d088 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.590957:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ce6a1726/0xd718aadfd785d0ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d0a4 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.590962:0:6514:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e058d006/0xd718aadfd785d11b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d114 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.590968:0:6514:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.591007:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e058d006/0xd718aadfd785d11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d114 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.591021:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e058d006/0xd718aadfd785d11b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d114 expref: 12 pid: 6517 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127247.591036:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876035789394432:0@lo:104: 00000100:00100000:3.0:1789127247.591098:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127247.591158:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ce6a1726/0xd718aadfd785d0ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d0a4 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.591166:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ce6a1726/0xd718aadfd785d0ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d0a4 expref: 12 pid: 6516 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127247.591174:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003cd0b9ed pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876035789394560:0@lo:104: 00000100:00100000:3.0:1789127247.591194:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127247.591225:0:6514:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002df52a2b/0xd718aadfd785d08f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d088 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.591238:0:6514:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002df52a2b/0xd718aadfd785d08f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d088 expref: 12 pid: 6516 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127247.591247:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002449c5f8 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876035789394688:0@lo:104: 00000100:00100000:3.0:1789127247.591270:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127247.591282:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a0baae7 going to sleep for 11 seconds 00000100:00100000:0.0:1789127247.591454:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789394432 00000100:00100000:0.0:1789127247.591462:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789394432 00000100:00100000:0.0:1789127247.591497:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789394560 00000100:00100000:0.0:1789127247.591500:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789394560 00000100:00100000:0.0:1789127247.591526:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789394688 00000100:00100000:0.0:1789127247.591535:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789394688 00000100:00100000:0.0:1789127247.591552:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127247.591559:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b695a1d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:6514:x1876035789394432:12345-0@lo:104: 00010000:00010000:0.0:1789127247.591571:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d11b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.591642:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127247.591647:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b695a1d3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:6514:x1876035789394432:12345-0@lo:104: Request processed in 89us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.591654:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127247.591669:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127247.591674:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c43b9c1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:6514:x1876035789394560:12345-0@lo:104: 00010000:00010000:0.0:1789127247.591681:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d0ab expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.591714:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789127247.591718:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c43b9c1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:6514:x1876035789394560:12345-0@lo:104: Request processed in 46us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.591724:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127247.591735:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127247.591740:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000632fbf0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6514:x1876035789394688:12345-0@lo:104: 00010000:00010000:0.0:1789127247.591746:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d08f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.591771:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789127247.591775:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000632fbf0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6514:x1876035789394688:12345-0@lo:104: Request processed in 36us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.591780:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789127247.591801:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789127247.591806:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d11b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.591812:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cc570c5b already unused, calling callback (000000001e5df574) 10000000:00010000:0.0:1789127247.591815:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d11b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.591821:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d11b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127247.591827:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d11b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127247.591832:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127247.591890:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d11b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.591898:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127247.591914:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d11b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.591921:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 00000000cc570c5b/0xd718aadfd785d114 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d11b expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.591932:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127247.591934:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d0ab expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.591940:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000021e26a0d already unused, calling callback (000000001e5df574) 10000000:00010000:0.0:1789127247.591941:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d0ab expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.591954:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d0ab expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127247.591959:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d0ab expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127247.591964:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127247.591977:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d0ab expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.591983:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127247.592003:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d0ab expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.592010:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 0000000021e26a0d/0xd718aadfd785d0a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d0ab expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127247.592016:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789394944:0@lo:103: 00010000:00010000:0.0:1789127247.592018:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127247.592020:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d08f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.592025:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d656c5c7 already unused, calling callback (000000001e5df574) 10000000:00010000:0.0:1789127247.592027:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d08f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.592032:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d08f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127247.592036:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d08f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127247.592046:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789127247.592049:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127247.592063:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d08f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.592068:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127247.592072:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d08f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.592077:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 00000000d656c5c7/0xd718aadfd785d088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d08f expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127247.592079:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127247.592083:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789395072:0@lo:103: 00010000:00010000:0.0:1789127247.592089:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127247.592091:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127247.592092:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127247.592102:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000958846a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789394816:0@lo:103: 00000100:00100000:2.0:1789127247.592103:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.592123:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127247.592132:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789394944 00000100:00100000:2.0:1789127247.592136:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789394944 00010000:00010000:2.0:1789127247.592153:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ce6a1726/0xd718aadfd785d0ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d0a4 expref: 13 pid: 6516 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127247.592167:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789395072 00000100:00100000:2.0:1789127247.592170:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789395072 00010000:00010000:2.0:1789127247.592179:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002df52a2b/0xd718aadfd785d08f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d088 expref: 14 pid: 6516 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127247.592189:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789394816 00000100:00100000:2.0:1789127247.592191:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789394816 00010000:00010000:2.0:1789127247.592198:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e058d006/0xd718aadfd785d11b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d114 expref: 15 pid: 6517 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127247.592222:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127247.592228:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002aec682 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:3652:x1876035789394944:12345-0@lo:103: 00010000:00010000:2.0:1789127247.592238:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127247.592242:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ce6a1726/0xd718aadfd785d0ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d0a4 expref: 15 pid: 6516 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592250:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ce6a1726/0xd718aadfd785d0ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d0a4 expref: 15 pid: 6516 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592263:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127247.592318:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002aec682 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:3652:x1876035789394944:12345-0@lo:103: Request processed in 76us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127247.592325:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1789127247.592328:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127247.592339:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127247.592344:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a33db54b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:3652:x1876035789395072:12345-0@lo:103: 00010000:00010000:2.0:1789127247.592351:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127247.592354:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002df52a2b/0xd718aadfd785d08f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d088 expref: 14 pid: 6516 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592361:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002df52a2b/0xd718aadfd785d08f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d088 expref: 14 pid: 6516 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592370:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127247.592390:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a33db54b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:3652:x1876035789395072:12345-0@lo:103: Request processed in 47us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127247.592396:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127247.592407:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127247.592421:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b517e5c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:3651:x1876035789394816:12345-0@lo:103: 00010000:00010000:2.0:1789127247.592429:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127247.592433:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e058d006/0xd718aadfd785d11b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d114 expref: 13 pid: 6517 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592441:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e058d006/0xd718aadfd785d11b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d114 expref: 13 pid: 6517 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592451:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592458:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592469:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592475:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592481:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592486:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592491:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000761dc32f already unused, calling callback (0000000040e5145c) 00010000:00010000:2.0:1789127247.592494:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592500:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592543:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.592554:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127247.592582:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b517e5c4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:3651:x1876035789394816:12345-0@lo:103: Request processed in 162us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127247.592588:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1789127247.592617:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e058d006/0xd718aadfd785d11b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d114 expref: 12 pid: 6517 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127247.592628:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876035789394432:0@lo:104: 00010000:00010000:3.0:1789127247.592638:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce6a1726/0xd718aadfd785d0ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d0a4 expref: 11 pid: 6516 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127247.592645:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003cd0b9ed pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876035789394560:0@lo:104: 00010000:00010000:3.0:1789127247.592653:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002df52a2b/0xd718aadfd785d08f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d088 expref: 10 pid: 6516 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127247.592660:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002449c5f8 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6514:1876035789394688:0@lo:104: 00010000:00010000:3.0:1789127247.592679:0:6514:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.592686:0:6514:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.592691:0:6514:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.592696:0:6514:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000761dc32f/0xd718aadfd785d15a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789127247.592716:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789127247.593098:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000958846a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789394816:0@lo:103: 00000100:00100000:0.0:1789127247.593242:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789395072:0@lo:103: 00000100:00100000:0.0:1789127247.593251:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789394944:0@lo:103: 00000100:00100000:1.0:1789127247.601966:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013545f43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+9:7452:x1876035789394304:12345-0@lo:253: Request processed in 47950us (54117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127247.601982:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789127247.602064:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a733cab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789394304:0@lo:253: 10000000:01000000:0.0:1789127247.602082:0:7452:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789127247.602085:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789127247.602086:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789127247.602088:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127247.602089:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1789127247.602090:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127247.602091:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127247.602092:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127247.602093:0:7452:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789127247.602100:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127247.602101:0:7452:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789127247.602119:0:7452:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000e803766 from lustre-MDT0001 10000000:01000000:0.0:1789127247.602150:0:7452:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1789127247.602152:0:7452:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789127247.602159:0:7452:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9346b18f3490 local copy 10000000:01000000:0.0:1789127247.602163:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789127247.602195:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.602204:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.602211:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127247.602228:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a733cab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789395200:0@lo:101: 00000100:00100000:0.0:1789127247.602262:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.602319:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bca3bbf6 going to sleep for 11 seconds 00000100:00100000:1.0:1789127247.602434:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789395200 00000100:00100000:1.0:1789127247.602440:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789395200 00000100:00100000:1.0:1789127247.602484:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789127247.602493:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009804c78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+9:7452:x1876035789395200:12345-0@lo:101: 00010000:00010000:1.0:1789127247.602504:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127247.602544:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff58a7dd/0xd718aadfd785d168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d161 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.602565:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff58a7dd/0xd718aadfd785d168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d161 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.602573:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff58a7dd/0xd718aadfd785d168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d161 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.602581:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff58a7dd, rc 0) 00000100:00100000:1.0:1789127247.602614:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009804c78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+10:7452:x1876035789395200:12345-0@lo:101: Request processed in 123us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127247.602620:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789127247.604465:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a733cab9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789395200:0@lo:101: 00010000:00010000:2.0:1789127247.604490:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd718aadfd785d168 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127247.604500:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd718aadfd785d168 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127247.604648:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003854b000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789395328:0@lo:501: 00000100:00100000:2.0:1789127247.604701:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127247.604738:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6161a78 going to sleep for 11 seconds 00000100:00100000:1.0:1789127247.604801:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789395328 00000100:00100000:1.0:1789127247.604807:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789395328 00000100:00100000:1.0:1789127247.604852:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789127247.604859:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a9335c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+10:7452:x1876035789395328:12345-0@lo:501: 00000100:00100000:1.0:1789127247.604939:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a9335c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+10:7452:x1876035789395328:12345-0@lo:501: Request processed in 81us (238us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789127247.604946:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789127247.605069:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003854b000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789395328:0@lo:501: 10000000:01000000:0.0:1789127247.605083:0:7452:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789127247.605105:0:7452:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789127247.605110:0:7452:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd718aadfd785d168 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605117:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd718aadfd785d168 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605124:0:7452:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd718aadfd785d168 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605167:0:7452:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789127247.605191:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9346b640b000 10000000:01000000:0.0:1789127247.605196:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789127247.605201:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9346b18f3490 10000000:01000000:0.0:1789127247.605203:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789127247.605206:0:7452:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9346b18f3490 from 1 10000000:01000000:0.0:1789127247.605209:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789127247.605230:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000d44a44b3/0xd718aadfd785d16f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605238:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000d44a44b3/0xd718aadfd785d16f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605245:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000d44a44b3/0xd718aadfd785d16f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127247.605256:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789395456:0@lo:101: 00000100:00100000:0.0:1789127247.605286:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.605335:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789395456 00000100:00100000:0.0:1789127247.605339:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789395456 00000100:00100000:0.0:1789127247.605366:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789127247.605373:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d03130b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+10:7452:x1876035789395456:12345-0@lo:101: 00010000:00010000:0.0:1789127247.605381:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127247.605393:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002329d745/0xd718aadfd785d176 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d16f expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605410:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002329d745/0xd718aadfd785d176 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d16f expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605429:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002329d745/0xd718aadfd785d176 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d16f expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605436:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002329d745, rc 0) 00000100:00100000:0.0:1789127247.605460:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d03130b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+11:7452:x1876035789395456:12345-0@lo:101: Request processed in 88us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.605466:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789127247.605493:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047ebb4cd going to sleep for 11 seconds 00000100:00100000:0.0:1789127247.605505:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789395456:0@lo:101: 00010000:00010000:0.0:1789127247.605541:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000d44a44b3/0xd718aadfd785d16f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d176 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605548:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000d44a44b3/0xd718aadfd785d16f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d176 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127247.605562:0:7452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789127247.605572:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000d44a44b3/0xd718aadfd785d16f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d176 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605578:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000d44a44b3/0xd718aadfd785d16f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d176 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127247.605586:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9346b640b000 10000000:01000000:0.0:1789127247.605605:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789127247.605608:0:7452:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9346b640b000 from 1 10000000:01000000:0.0:1789127247.605610:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789127247.605624:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000352b199a/0xd718aadfd785d17d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605636:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000352b199a/0xd718aadfd785d17d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605642:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000352b199a/0xd718aadfd785d17d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127247.605652:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789395584:0@lo:101: 00000100:00100000:0.0:1789127247.605678:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.605697:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789395584 00000100:00100000:0.0:1789127247.605701:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789395584 00000100:00100000:0.0:1789127247.605720:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789127247.605726:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000944fb86f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+11:7452:x1876035789395584:12345-0@lo:101: 00010000:00010000:0.0:1789127247.605732:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127247.605739:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000025a8c212/0xd718aadfd785d184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d17d expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605751:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000025a8c212/0xd718aadfd785d184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d17d expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605757:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000025a8c212/0xd718aadfd785d184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d17d expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605763:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000025a8c212, rc 0) 00000100:00100000:0.0:1789127247.605786:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000944fb86f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:7452:x1876035789395584:12345-0@lo:101: Request processed in 61us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.605792:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789127247.605814:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047ebb4cd going to sleep for 11 seconds 00000100:00100000:0.0:1789127247.605825:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789395584:0@lo:101: 00010000:00010000:0.0:1789127247.605841:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000352b199a/0xd718aadfd785d17d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605848:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000352b199a/0xd718aadfd785d17d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127247.605858:0:7452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789127247.605866:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000352b199a/0xd718aadfd785d17d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605872:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000352b199a/0xd718aadfd785d17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127247.605877:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1789127247.605889:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789127247.605893:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9346b640b000 10000000:01000000:0.0:1789127247.605896:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789127247.605913:0:7452:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1789127247.605915:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789127247.605928:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 000000003d627c0a/0xd718aadfd785d18b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605933:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 000000003d627c0a/0xd718aadfd785d18b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.605939:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 000000003d627c0a/0xd718aadfd785d18b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127247.605948:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789395712:0@lo:101: 00000100:00100000:0.0:1789127247.605971:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.605998:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789395712 00000100:00100000:0.0:1789127247.606002:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789395712 00000100:00100000:0.0:1789127247.606022:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789127247.606028:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007eb6cec8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:7452:x1876035789395712:12345-0@lo:101: 00010000:00010000:0.0:1789127247.606034:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127247.606040:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032205af9/0xd718aadfd785d192 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d18b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.606051:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032205af9/0xd718aadfd785d192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d18b expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.606058:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032205af9/0xd718aadfd785d192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d18b expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.606063:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032205af9, rc 0) 00000100:00100000:0.0:1789127247.606086:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007eb6cec8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:7452:x1876035789395712:12345-0@lo:101: Request processed in 58us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.606091:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789127247.606114:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047ebb4cd going to sleep for 11 seconds 00000100:00100000:0.0:1789127247.606126:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789395712:0@lo:101: 00010000:00010000:0.0:1789127247.606134:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 000000003d627c0a/0xd718aadfd785d18b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d192 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.606140:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 000000003d627c0a/0xd718aadfd785d18b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d192 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127247.606224:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789395840:0@lo:501: 00000100:00100000:0.0:1789127247.606249:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.606268:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789395840 00000100:00100000:0.0:1789127247.606277:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789395840 00000100:00100000:0.0:1789127247.606297:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789127247.606303:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009abf0c62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:7452:x1876035789395840:12345-0@lo:501: 00000100:00100000:0.0:1789127247.606400:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009abf0c62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:7452:x1876035789395840:12345-0@lo:501: Request processed in 98us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.606407:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789127247.606428:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047ebb4cd going to sleep for 11 seconds 00000100:00100000:0.0:1789127247.606439:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789395840:0@lo:501: 00000100:00100000:0.0:1789127247.606462:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789395968:0@lo:503: 00000100:00100000:0.0:1789127247.606499:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.606542:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789395968 00000100:00100000:0.0:1789127247.606545:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789395968 00000100:00100000:0.0:1789127247.606566:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789127247.606571:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca1a7aa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:7452:x1876035789395968:12345-0@lo:503: 00000100:00100000:0.0:1789127247.606639:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca1a7aa6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:7452:x1876035789395968:12345-0@lo:503: Request processed in 68us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.606645:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789127247.606677:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047ebb4cd going to sleep for 11 seconds 00000100:00100000:0.0:1789127247.606689:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789395968:0@lo:503: 00000040:00080000:0.0:1789127247.606891:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789127247.606959:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789396096:0@lo:502: 00000100:00100000:0.0:1789127247.606995:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.607017:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789396096 00000100:00100000:0.0:1789127247.607021:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789396096 00000100:00100000:0.0:1789127247.607042:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127247.607048:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009aff7a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:7452:x1876035789396096:12345-0@lo:502: 00000100:00100000:0.0:1789127247.607120:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009aff7a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:7452:x1876035789396096:12345-0@lo:502: Request processed in 72us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.607126:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127247.607154:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047ebb4cd going to sleep for 11 seconds 00000100:00100000:0.0:1789127247.607166:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789396096:0@lo:502: 00000040:00080000:0.0:1789127247.607334:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789127247.607358:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:0.0:1789127247.607372:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:0.0:1789127247.607385:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:0.0:1789127247.607408:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:0.0:1789127247.607422:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:0.0:1789127247.607434:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:0.0:1789127247.607446:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:0.0:1789127247.607458:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:0.0:1789127247.607470:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:0.0:1789127247.607482:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:0.0:1789127247.607494:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:0.0:1789127247.607505:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:0.0:1789127247.607545:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:0.0:1789127247.607557:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:0.0:1789127247.607568:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:0.0:1789127247.607582:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:0.0:1789127247.607594:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:0.0:1789127247.607607:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:0.0:1789127247.607619:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:0.0:1789127247.607643:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:0.0:1789127247.607657:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:0.0:1789127247.607670:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:0.0:1789127247.607691:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789396224:0@lo:502: 00000100:00100000:0.0:1789127247.607725:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.607755:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789396224 00000100:00100000:0.0:1789127247.607759:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789396224 00000100:00100000:0.0:1789127247.607784:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127247.607789:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edd185b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:7452:x1876035789396224:12345-0@lo:502: 00000100:00100000:0.0:1789127247.607845:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edd185b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:7452:x1876035789396224:12345-0@lo:502: Request processed in 56us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.607852:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127247.607883:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047ebb4cd going to sleep for 11 seconds 00010000:00010000:1.0:1789127247.608774:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127247.608782:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd718aadfd785d168 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.608808:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006931ca05 already unused, calling callback (000000001e5df574) 10000000:00010000:1.0:1789127247.608810:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd718aadfd785d168 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.608818:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd718aadfd785d168 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127247.608825:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd718aadfd785d168 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127247.608830:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789127247.608857:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd718aadfd785d168 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.608862:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127247.608888:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd718aadfd785d168 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.608895:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd718aadfd785d168 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.608921:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127247.608922:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127247.608923:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127247.608931:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127247.608946:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005870bbc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789396352:0@lo:103: 00000100:00100000:1.0:1789127247.608991:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127247.609433:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789396352 00000100:00100000:3.0:1789127247.609440:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789396352 00000100:00100000:3.0:1789127247.609488:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127247.609496:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b97942b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:3651:x1876035789396352:12345-0@lo:103: 00010000:00010000:3.0:1789127247.609527:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127247.609542:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ff58a7dd/0xd718aadfd785d168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d161 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.609556:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127247.609593:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b97942b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:3651:x1876035789396352:12345-0@lo:103: Request processed in 98us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127247.609601:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127247.609633:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005870bbc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789396352:0@lo:103: 00000100:00100000:0.0:1789127247.611440:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e53adca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789396224:0@lo:502: 00000040:00080000:0.0:1789127247.611592:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:0.0:1789127247.611606:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1789127247.612548:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127247.612560:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127247.612562:0:7464:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789127247.612567:0:7464:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789127247.612571:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127247.612586:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (0000000000ec98c1) 00000020:00000080:3.0:1789127247.612606:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1789127247.612612:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789127247.612705:0:7464:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789127247.612713:0:7464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd718aadfd785d1a0 00000020:00000080:3.0:1789127247.612932:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789127247.612938:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127247.612941:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127247.612943:0:7464:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789127247.612951:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127247.612955:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127247.612956:0:7464:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789127247.612959:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127247.612966:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000f06f2bbb) 00000020:00000080:3.0:1789127247.612976:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1789127247.612980:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789127247.612981:0:7464:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789127247.612984:0:7464:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789127247.612989:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789127247.613040:0:7464:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000e803766 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789127247.613052:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000068042fb) 00000020:00000080:3.0:1789127247.613060:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1789127247.613106:0:7464:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789127247.613111:0:7464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd718aadfd785d1b5 00000020:00000080:3.0:1789127247.613198:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789127247.613205:0:7464:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789127247.613210:0:7464:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd718aadfd785d1bc 00080000:01000000:3.0:1789127247.613216:0:7464:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789127247.613218:0:7464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd718aadfd785d1c3 00080000:10000000:0.0:1789127247.618229:0:7464:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1789127247.619203:0:7464:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1789127247.773613:0:7464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1789127247.773857:0:7464:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1789127247.782210:0:7464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789127247.782611:0:7464:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789127247.801239:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789127247.801251:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127247.801257:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127247.801259:0:7464:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789127247.801262:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127247.801268:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127247.801269:0:7464:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789127247.801271:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789127247.801276:0:7464:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:00000080:0.0:1789127247.801302:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127247.801325:0:7464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000e64a12cf) 00000020:00000080:0.0:1789127247.801346:0:7464:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789127247.801351:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789127247.801415:0:7464:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789127247.801421:0:7464:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789127247.801427:0:7464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd718aadfd785d1d1 00010000:00080000:0.0:1789127247.801460:0:7464:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000df407637@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.148@tcp at head 00010000:00010000:0.0:1789127247.803968:0:7464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00010000:00010000:1.0:1789127247.805964:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789127247.810411:0:7464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789127247.810427:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789127247.810463:0:7464:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789127247.810485:0:7464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd718aadfd785d1d8 00000100:00080000:1.0:1789127247.810495:0:7464:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789127247.810499:0:7464:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000df407637 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789127247.810572:0:7464:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007188dbbf x1876035789396480/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127247.810589:0:7464:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789127247.810667:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127247.810679:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005870bbc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789396608:0@lo:400: 00000100:00100000:1.0:1789127247.810744:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127247.810803:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006a7851d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789396736:0@lo:400: 00000100:00100000:1.0:1789127247.810833:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127247.810877:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789396608 00000100:00100000:1.0:1789127247.810883:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789396608 00000100:00100000:1.0:1789127247.810919:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789127247.810927:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7dbc481 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:3650:x1876035789396608:12345-0@lo:400: 00000100:00100000:1.0:1789127247.810975:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7dbc481 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:3650:x1876035789396608:12345-0@lo:400: Request processed in 49us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127247.810982:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789127247.811027:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005870bbc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789396608:0@lo:400: 00000020:01000000:1.0:1789127247.811086:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127247.811090:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127247.811092:0:7464:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789127247.811095:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789127247.811104:0:7464:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789127247.811106:0:7464:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789127247.811108:0:7464:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789127247.811109:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789127247.811112:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127247.811113:0:7464:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789127247.811115:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127247.811119:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127247.811121:0:7464:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789127247.811124:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789127247.811163:0:7464:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789127247.811177:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127247.811180:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127247.811181:0:7464:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789127247.811184:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127247.811186:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127247.811188:0:7464:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789127247.811190:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789127247.811192:0:7464:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789127247.811219:0:7464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127247.811222:0:7464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127247.811223:0:7464:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789127247.811225:0:7464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:0.0:1789127247.811558:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007188dbbf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789396480:0@lo:38: 00000100:00100000:0.0:1789127247.811596:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:0.0:1789127247.811639:0:7452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:0.0:1789127247.811667:0:7452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789127247.811681:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 000000003d627c0a/0xd718aadfd785d18b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d192 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.811689:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 000000003d627c0a/0xd718aadfd785d18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d192 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127247.811696:0:7452:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9346b640b000 from 1 10000000:01000000:0.0:1789127247.811698:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127247.811723:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.811729:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.811738:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127247.811751:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789396864:0@lo:101: 00000100:00100000:0.0:1789127247.811779:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.811795:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bca3bbf6 going to sleep for 11 seconds 00000100:00100000:0.0:1789127247.812014:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789396864 00000100:00100000:0.0:1789127247.812020:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789396864 00000100:00100000:0.0:1789127247.812050:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789127247.812057:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca3f98af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+12:7452:x1876035789396864:12345-0@lo:101: 00010000:00010000:0.0:1789127247.812076:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127247.812086:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000efb22128/0xd718aadfd785d1e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d1df expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.812106:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efb22128/0xd718aadfd785d1e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d1df expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.812115:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000efb22128/0xd718aadfd785d1e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d1df expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.812122:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000efb22128, rc 0) 00000100:00100000:0.0:1789127247.812152:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca3f98af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:7452:x1876035789396864:12345-0@lo:101: Request processed in 95us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.812158:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789127247.812184:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789396736 00000100:00100000:0.0:1789127247.812189:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789396736 00000100:00100000:0.0:1789127247.812213:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127247.812220:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000006640e29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789396736:12345-0@lo:400: 00000100:00100000:0.0:1789127247.812257:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000006640e29 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789396736:12345-0@lo:400: Request processed in 38us (1423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.812263:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127247.812291:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789396864:0@lo:101: 00010000:00010000:0.0:1789127247.812322:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d1e6 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.812330:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d1e6 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127247.812888:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789396992:0@lo:256: 00000100:00100000:0.0:1789127247.813255:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.813280:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f5f7346 going to sleep for 11 seconds 00000100:00100000:1.0:1789127247.814117:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789396480 00000100:00100000:1.0:1789127247.814128:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789396480 00000100:00100000:1.0:1789127247.814170:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127247.814176:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e53adca7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1876035789396480:12345-0@lo:38: 00010000:00080000:1.0:1789127247.814200:0:6527:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:1.0:1789127247.814233:0:6527:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd718aadfd785d1ed 00000004:00100000:1.0:1789127247.814248:0:6527:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789127247.814253:0:6527:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789127247.815493:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789396992 00000100:00100000:1.0:1789127247.815529:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789396992 00000100:00100000:1.0:1789127247.815580:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789127247.815589:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c1ae2d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:7452:x1876035789396992:12345-0@lo:256: 20000000:01000000:1.0:1789127247.815610:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789127247.815626:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789127247.815628:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789127247.815745:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c1ae2d4b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:7452:x1876035789396992:12345-0@lo:256: Request processed in 158us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127247.815753:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789127247.815808:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006a7851d4 x1876035789396736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127247.815823:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006a7851d4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789396736:0@lo:400: 00000100:00100000:0.0:1789127247.817066:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789396992:0@lo:256: 10000000:01000000:0.0:1789127247.817788:0:7452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789127247.817813:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d1e6 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.817823:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d1e6 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127247.817832:0:7452:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b640b000 from 1 10000000:01000000:0.0:1789127247.817835:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127247.817867:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.817874:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.817883:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127247.826750:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789397120:0@lo:101: 00000100:00100000:0.0:1789127247.826828:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.826869:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f5f7346 going to sleep for 11 seconds 00000100:00100000:1.0:1789127247.827049:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789397120 00000100:00100000:1.0:1789127247.827057:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789397120 00000100:00100000:1.0:1789127247.827103:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789127247.827111:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a16c1601 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:7452:x1876035789397120:12345-0@lo:101: 00010000:00010000:1.0:1789127247.827125:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127247.827141:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c1509ad7/0xd718aadfd785d1fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d1f4 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.827167:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1509ad7/0xd718aadfd785d1fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d1f4 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.827177:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c1509ad7/0xd718aadfd785d1fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d1f4 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.827185:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c1509ad7, rc 0) 00000100:00100000:1.0:1789127247.827222:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a16c1601 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:7452:x1876035789397120:12345-0@lo:101: Request processed in 113us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127247.827237:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789127247.827639:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789397120:0@lo:101: 00010000:00010000:0.0:1789127247.827656:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d1fb expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.827664:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d1fb expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127247.827778:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789397248:0@lo:501: 00000100:00100000:0.0:1789127247.827806:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.827843:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f5f7346 going to sleep for 11 seconds 00000100:00100000:1.0:1789127247.827896:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789397248 00000100:00100000:1.0:1789127247.827901:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789397248 00000100:00100000:1.0:1789127247.827934:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789127247.827940:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6d6602c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:7452:x1876035789397248:12345-0@lo:501: 00000100:00100000:1.0:1789127247.828029:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6d6602c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:7452:x1876035789397248:12345-0@lo:501: Request processed in 89us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127247.828036:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789127247.828899:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789397248:0@lo:501: 00000100:00100000:0.0:1789127247.828941:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789397376:0@lo:503: 00000100:00100000:0.0:1789127247.828988:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.829022:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f5f7346 going to sleep for 11 seconds 00000100:00100000:1.0:1789127247.829077:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789397376 00000100:00100000:1.0:1789127247.829084:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789397376 00000100:00100000:1.0:1789127247.829121:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789127247.829129:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000092c664f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:7452:x1876035789397376:12345-0@lo:503: 00000040:00080000:1.0:1789127247.829166:0:6514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127247.829217:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000092c664f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:7452:x1876035789397376:12345-0@lo:503: Request processed in 89us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127247.829225:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127247.829663:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789397376:0@lo:503: 00000040:00080000:2.0:1789127247.829923:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127247.829983:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1789127247.830062:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:0.0:1789127247.832542:0:6527:0:(import.c:65:import_set_state_nolock()) 00000000ae88ea52 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127247.832623:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e53adca7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1876035789396480:12345-0@lo:38: Request processed in 18445us (21025us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.832637:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127247.834638:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127247.834655:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789127247.834663:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1789127247.834668:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789127247.834684:0:3649:0:(import.c:65:import_set_state_nolock()) 00000000df407637 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789127247.834702:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007188dbbf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789396480:0@lo:38: 00000100:00100000:2.0:1789127247.835233:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d22b06e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789397504:0@lo:41: 00000100:00100000:2.0:1789127247.835294:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.836484:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789397504 00000100:00100000:0.0:1789127247.836495:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789397504 00000100:00100000:0.0:1789127247.836565:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127247.836573:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a052bc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1876035789397504:12345-0@lo:41: 00000004:00000024:0.0:1789127247.836606:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789127247.836671:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a052bc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3653:x1876035789397504:12345-0@lo:41: Request processed in 98us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.836678:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127247.836775:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d22b06e7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789397504:0@lo:41: 00000040:00080000:0.0:1789127247.842227:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1789127247.843289:0:7452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789127247.843343:0:7452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127247.843364:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d1fb expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.843377:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d1fb expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127247.843438:0:7452:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789127247.843440:0:7452:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9346b640b000 10000000:01000000:3.0:1789127247.843443:0:7452:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9346b640b000 10000000:01000000:3.0:1789127247.843456:0:7452:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789127247.843462:0:7452:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9346b640b000 from 1 10000000:01000000:3.0:1789127247.843465:0:7452:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789127247.843499:0:7452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000761dc32f/0xd718aadfd785d202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.843525:0:7452:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000761dc32f/0xd718aadfd785d202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.843536:0:7452:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000761dc32f/0xd718aadfd785d202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127247.843559:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002449c5f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789397632:0@lo:101: 00000100:00100000:3.0:1789127247.843625:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127247.843666:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000063bb2552 going to sleep for 11 seconds 00000100:00100000:0.0:1789127247.843992:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789397632 00000100:00100000:0.0:1789127247.843999:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789397632 00000100:00100000:0.0:1789127247.844047:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789127247.844054:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009107b26f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:7452:x1876035789397632:12345-0@lo:101: 00010000:00010000:0.0:1789127247.844066:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127247.844085:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee0c020c/0xd718aadfd785d209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d202 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.844105:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee0c020c/0xd718aadfd785d209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d202 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.844114:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee0c020c/0xd718aadfd785d209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d202 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.844121:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee0c020c, rc 0) 00000100:00100000:0.0:1789127247.844167:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009107b26f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7452:x1876035789397632:12345-0@lo:101: Request processed in 114us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.844174:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789127247.845057:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002449c5f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789397632:0@lo:101: 00010000:00010000:3.0:1789127247.845077:0:7452:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000761dc32f/0xd718aadfd785d202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d209 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.845085:0:7452:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000761dc32f/0xd718aadfd785d202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d209 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127247.845184:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002449c5f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789397760:0@lo:501: 00000100:00100000:3.0:1789127247.845221:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127247.845250:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000063bb2552 going to sleep for 11 seconds 00000100:00100000:0.0:1789127247.845597:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789397760 00000100:00100000:0.0:1789127247.845604:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789397760 00000100:00100000:0.0:1789127247.845646:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789127247.845654:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076eb4ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7452:x1876035789397760:12345-0@lo:501: 00000100:00100000:0.0:1789127247.845768:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076eb4ca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7452:x1876035789397760:12345-0@lo:501: Request processed in 115us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.845776:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789127247.846437:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002449c5f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789397760:0@lo:501: 00000100:00100000:3.0:1789127247.846472:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002449c5f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789397888:0@lo:503: 00000100:00100000:3.0:1789127247.846552:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127247.846585:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000063bb2552 going to sleep for 11 seconds 00000100:00100000:1.0:1789127247.846647:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789397888 00000100:00100000:1.0:1789127247.846652:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789397888 00000100:00100000:1.0:1789127247.846684:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789127247.846691:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dc71573 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7452:x1876035789397888:12345-0@lo:503: 00000100:00100000:1.0:1789127247.846784:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dc71573 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7452:x1876035789397888:12345-0@lo:503: Request processed in 94us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127247.846790:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789127247.846857:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002449c5f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789397888:0@lo:503: 00000040:00080000:3.0:1789127247.847149:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127247.847216:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002449c5f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789398016:0@lo:502: 00000100:00100000:3.0:1789127247.847253:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127247.847332:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4d58782 going to sleep for 11 seconds 00000100:00100000:1.0:1789127247.849661:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789398016 00000100:00100000:1.0:1789127247.849674:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789398016 00000100:00100000:1.0:1789127247.849783:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789127247.849793:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000affc1e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7452:x1876035789398016:12345-0@lo:502: 00000100:00100000:1.0:1789127247.849963:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000affc1e61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7452:x1876035789398016:12345-0@lo:502: Request processed in 172us (2710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127247.849972:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789127247.850075:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002449c5f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789398016:0@lo:502: 00000040:00080000:3.0:1789127247.850292:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789127247.850337:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789127247.850351:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789127247.850363:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789127247.850375:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789127247.850388:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789127247.850400:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789127247.850411:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789127247.850423:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789127247.850435:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789127247.850448:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789127247.850460:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789127247.850471:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789127247.850483:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789127247.850494:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789127247.850537:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789127247.850556:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789127247.850569:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789127247.850581:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789127247.850592:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789127247.850604:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789127247.850616:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789127247.850629:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789127247.850642:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789127247.850678:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789127247.850694:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789127247.850708:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789127247.850720:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1789127247.850754:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002449c5f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789398144:0@lo:502: 00000100:00100000:3.0:1789127247.850802:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127247.850835:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4d58782 going to sleep for 11 seconds 00000100:00100000:1.0:1789127247.852476:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789398144 00000100:00100000:1.0:1789127247.852488:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789398144 00000100:00100000:1.0:1789127247.852556:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789127247.852566:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4eebbc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7452:x1876035789398144:12345-0@lo:502: 00000100:00100000:1.0:1789127247.852702:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4eebbc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7452:x1876035789398144:12345-0@lo:502: Request processed in 137us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127247.852710:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789127247.853115:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002449c5f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789398144:0@lo:502: 00000040:00080000:3.0:1789127247.853195:0:7452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789127247.853207:0:7452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1789127247.854615:0:7470:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789127247.854629:0:7470:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000859dc1c4) 00000020:00000080:0.0:1789127247.854649:0:7470:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789127247.854723:0:7470:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000e803766 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789127247.854727:0:7470:0:(tgt_mount.c:187:server_put_mount()) put mount 000000000e803766 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789127247.854729:0:7470:0:(obd_mount.c:710:lustre_put_lsi()) put 000000000e803766 3 00010000:00080000:0.0:1789127247.854765:0:7470:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000008712ac5@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.148@tcp at head 00010000:00010000:0.0:1789127247.859332:0:7470:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:0.0:1789127247.859584:0:7470:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789127247.859627:0:7470:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789127247.859646:0:7470:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd718aadfd785d217 00000100:00080000:0.0:1789127247.859655:0:7470:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127247.859659:0:7470:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000008712ac5 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789127247.859690:0:7470:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000929e76dc x1876035789398272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127247.859720:0:7470:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789127247.868685:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000929e76dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876035789398272:0@lo:38: 00000100:00100000:2.0:1789127247.868771:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.868890:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789398272 00000100:00100000:0.0:1789127247.868908:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789398272 00000100:00100000:0.0:1789127247.868972:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127247.868979:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c047ab6c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1876035789398272:12345-0@lo:38: 00010000:00080000:0.0:1789127247.869004:0:6522:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:0.0:1789127247.869037:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd718aadfd785d21e 00000004:00100000:0.0:1789127247.869050:0:6522:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789127247.869077:0:6522:0:(import.c:65:import_set_state_nolock()) 00000000796e58d1 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127247.869126:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c047ab6c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876035789398272:12345-0@lo:38: Request processed in 146us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.869134:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789127247.870018:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000929e76dc x1876035789398272/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127247.870031:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127247.870040:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789127247.870047:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789127247.870052:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789127247.870055:0:3649:0:(import.c:65:import_set_state_nolock()) 0000000008712ac5 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789127247.870060:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000929e76dc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876035789398272:0@lo:38: 00000040:00080000:2.0:1789127247.872604:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 40000000:00080000:0.0:1789127247.872790:0:7472:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:3.0:1789127247.872893:0:7452:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1789127247.872935:0:7452:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127247.872956:0:7452:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000761dc32f/0xd718aadfd785d202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d209 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.872966:0:7452:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000761dc32f/0xd718aadfd785d202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d209 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789127247.873014:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789127247.873017:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789127247.873018:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127247.873019:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127247.873020:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127247.873022:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127247.873023:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127247.873024:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789127247.873025:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789127247.873027:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127247.873028:0:7452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127247.873031:0:7452:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1789127247.873034:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789127247.873035:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789127247.873036:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127247.873043:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127247.873043:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127247.873044:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127247.873045:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127247.873046:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789127247.873047:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789127247.873047:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127247.873049:0:7452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127247.873072:0:7452:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789127247.873089:0:7452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002449c5f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789398400:0@lo:253: 00000100:00100000:3.0:1789127247.873157:0:7452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127247.873191:0:7452:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007925db8 going to sleep for 11 seconds 00000100:00100000:2.0:1789127247.874497:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789398400 00000100:00100000:2.0:1789127247.874529:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789398400 00000100:00100000:2.0:1789127247.874580:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789127247.874589:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000bc374ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7452:x1876035789398400:12345-0@lo:253: 20000000:01000000:2.0:1789127247.874621:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789127247.874634:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1789127247.892593:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1789127247.892648:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789127247.892665:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789127247.892786:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789127247.892791:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789127247.892810:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.892826:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000128b6a2e/0xd718aadfd785d145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d13e expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.892833:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000efb22128/0xd718aadfd785d1e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d1df expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.892856:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.892892:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000efb22128/0xd718aadfd785d1e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d1df expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.892905:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000efb22128/0xd718aadfd785d1e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d1df expref: 15 pid: 6517 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127247.892920:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000039983bc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1876035789398528:0@lo:104: 00000100:00100000:0.0:1789127247.892984:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127247.893031:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000128b6a2e/0xd718aadfd785d145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d13e expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127247.893038:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000128b6a2e/0xd718aadfd785d145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d13e expref: 15 pid: 6516 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127247.893046:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f6414ea pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1876035789398656:0@lo:104: 00000100:00100000:0.0:1789127247.893068:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127247.893130:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f5f7346 going to sleep for 11 seconds 00000100:00100000:1.0:1789127247.893293:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000bc374ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7452:x1876035789398400:12345-0@lo:253: Request processed in 18704us (20135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127247.895415:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789127247.895586:0:7452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002449c5f8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:7452:1876035789398400:0@lo:253: 10000000:01000000:0.0:1789127247.895604:0:7452:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789127247.895607:0:7452:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789127247.895609:0:7452:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789127247.895610:0:7452:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127247.895612:0:7452:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127247.895613:0:7452:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127247.895614:0:7452:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127247.895615:0:7452:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127247.895616:0:7452:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789127247.895629:0:7452:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789127247.895630:0:7452:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127247.895631:0:7452:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789127247.895645:0:7452:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789127247.896727:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789398528 00000100:00100000:3.0:1789127247.896738:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789398528 00000100:00100000:3.0:1789127247.896773:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789398656 00000100:00100000:3.0:1789127247.896776:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789398656 00000100:00100000:3.0:1789127247.896790:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127247.896796:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019dacf27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:6538:x1876035789398528:12345-0@lo:104: 00010000:00010000:3.0:1789127247.896813:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d1e6 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.896900:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127247.896906:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019dacf27 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:6538:x1876035789398528:12345-0@lo:104: Request processed in 110us (3923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127247.896913:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127247.896929:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127247.896935:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000929e76dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6538:x1876035789398656:12345-0@lo:104: 00010000:00010000:3.0:1789127247.896943:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d145 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.896977:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789127247.896981:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000929e76dc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6538:x1876035789398656:12345-0@lo:104: Request processed in 48us (3914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127247.896993:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127247.897018:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000039983bc pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1876035789398528:0@lo:104: 00010000:00010000:3.0:1789127247.897023:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789127247.897027:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f6414ea pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1876035789398656:0@lo:104: 00010000:00010000:3.0:1789127247.897028:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d1e6 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897035:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006931ca05 already unused, calling callback (000000001e5df574) 10000000:00010000:3.0:1789127247.897037:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d1e6 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897044:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d1e6 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.897047:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127247.897050:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d1e6 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127247.897055:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127247.897085:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d1e6 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897092:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127247.897116:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d1e6 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897122:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 000000006931ca05/0xd718aadfd785d1df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d1e6 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897132:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127247.897134:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d145 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897149:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002e84ddcc already unused, calling callback (000000001e5df574) 10000000:00010000:3.0:1789127247.897151:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d145 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897157:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d145 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127247.897163:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d145 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127247.897167:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1789127247.897173:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003cd0b9ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789398784:0@lo:103: 00010000:00010000:3.0:1789127247.897183:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d145 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897188:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127247.897191:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d145 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897196:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 000000002e84ddcc/0xd718aadfd785d13e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d145 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897209:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127247.897210:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127247.897210:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127247.897212:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127247.897218:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127247.897226:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789398912:0@lo:103: 00000100:00100000:3.0:1789127247.897252:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127247.897272:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789398784 00000100:00100000:1.0:1789127247.897276:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789398784 00000100:00100000:3.0:1789127247.897279:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789398912 00000100:00100000:3.0:1789127247.897282:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789398912 00010000:00010000:1.0:1789127247.897293:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000efb22128/0xd718aadfd785d1e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d1df expref: 16 pid: 6517 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897296:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000128b6a2e/0xd718aadfd785d145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d13e expref: 16 pid: 6516 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127247.897331:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127247.897337:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bd28ce5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:3651:x1876035789398912:12345-0@lo:103: 00010000:00010000:3.0:1789127247.897346:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127247.897350:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000128b6a2e/0xd718aadfd785d145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d13e expref: 16 pid: 6516 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897358:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000128b6a2e/0xd718aadfd785d145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d13e expref: 16 pid: 6516 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897371:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000128b6a2e/0xd718aadfd785d145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d13e expref: 16 pid: 6516 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897381:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127247.897409:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bd28ce5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:3651:x1876035789398912:12345-0@lo:103: Request processed in 73us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127247.897415:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127247.897443:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789398912:0@lo:103: 00000100:00100000:1.0:1789127247.897457:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127247.897469:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a7851d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:3650:x1876035789398784:12345-0@lo:103: 00010000:00010000:1.0:1789127247.897477:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127247.897480:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000efb22128/0xd718aadfd785d1e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d1df expref: 14 pid: 6517 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.897488:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000efb22128/0xd718aadfd785d1e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d1df expref: 14 pid: 6517 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.897498:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000efb22128/0xd718aadfd785d1e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d1df expref: 14 pid: 6517 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.897529:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.897538:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789127247.897550:0:6508:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004760424s 00010000:00010000:1.0:1789127247.897554:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.897560:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.897565:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.897570:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.897575:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000df88ce8b already unused, calling callback (0000000040e5145c) 00010000:00010000:1.0:1789127247.897583:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.897590:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.897600:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897605:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127247.897609:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127247.897611:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127247.897616:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000df88ce8b/0xd718aadfd785d225 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127247.897634:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a7851d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:3650:x1876035789398784:12345-0@lo:103: Request processed in 166us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127247.897640:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127247.897687:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003cd0b9ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789398784:0@lo:103: 00080000:10000000:1.0:1789127247.904460:0:7452:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:1.0:1789127247.904677:0:7452:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789127247.905143:0:7452:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1789127247.905602:0:7452:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789127247.907866:0:7452:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789127247.908207:0:7452:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1789127247.910165:0:7452:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789127247.912016:0:7452:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789127247.912462:0:7452:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789127247.912697:0:7452:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789127247.912975:0:7452:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1789127247.913161:0:7452:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1789127247.917049:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:2.0:1789127247.919076:0:7476:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789127247.919124:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1789127247.919149:0:7476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4b6354c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7476:1876035789399040:0@lo:700: 00000100:00100000:2.0:1789127247.919212:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127247.919253:0:7476:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d31118d7 going to sleep for 11 seconds 00000040:01000000:1.0:1789127247.920299:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789127247.920501:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789127247.921116:0:7452:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789127247.921125:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789127247.921295:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127247.921830:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876035789399168:0@lo:1000: 00000100:00100000:3.0:1789127247.922126:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127247.922170:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789399168 00000100:00100000:3.0:1789127247.922176:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789399168 00000100:00100000:3.0:1789127247.922213:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127247.922220:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000681fa787 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1876035789399168:12345-0@lo:1000: 00000100:00100000:3.0:1789127247.922291:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000681fa787 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1876035789399168:12345-0@lo:1000: Request processed in 71us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127247.922298:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127247.922397:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a4d58782 going to sleep for 11 seconds 00000100:00100000:3.0:1789127247.922419:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876035789399168:0@lo:1000: 00000040:01000000:3.0:1789127247.922446:0:7477:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:3.0:1789127247.922468:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876035789399296:0@lo:700: 00000100:00100000:3.0:1789127247.922490:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127247.922534:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 00000000922e0667 going to sleep for 11 seconds 00000100:00100000:2.0:1789127247.922604:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789399296 00000100:00100000:2.0:1789127247.922608:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789399296 00000100:00100000:2.0:1789127247.922629:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127247.922634:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b6e0f70 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7477:x1876035789399296:12345-0@lo:700: 00000100:00100000:2.0:1789127247.922671:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b6e0f70 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7477:x1876035789399296:12345-0@lo:700: Request processed in 37us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127247.922677:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127247.922845:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876035789399296:0@lo:700: 00000100:00100000:3.0:1789127247.922884:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7477:1876035789399424:0@lo:900: 00000100:00100000:3.0:1789127247.924035:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127247.924182:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 00000000922e0667 going to sleep for 11 seconds 00000020:00080000:0.0:1789127247.924416:0:7475:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789127247.924420:0:7475:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:2.0:1789127247.924506:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789399424 00000100:00100000:2.0:1789127247.924535:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789399424 00000100:00100000:2.0:1789127247.924577:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127247.924585:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd44c790 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7477:x1876035789399424:12345-0@lo:900: 00000100:00100000:2.0:1789127247.924641:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd44c790 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7477:x1876035789399424:12345-0@lo:900: Request processed in 57us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127247.924648:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789127247.925139:0:7477:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003b504001 x1876035789399424/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789127263 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127247.925152:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7477:1876035789399424:0@lo:900: 00000100:00100000:3.0:1789127247.925430:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876035789399552:0@lo:1000: 00000100:00100000:3.0:1789127247.925469:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127247.925500:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 000000002a0baae7 going to sleep for 11 seconds 00000100:00100000:0.0:1789127247.925582:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789399552 00000100:00100000:0.0:1789127247.925587:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789399552 00000100:00100000:1.0:1789127247.925595:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789399040 00000100:00100000:1.0:1789127247.925600:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789399040 00000100:00100000:1.0:1789127247.925621:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127247.925621:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789127247.925627:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b9b4c3a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7476:x1876035789399040:12345-0@lo:700: 00000100:00100000:0.0:1789127247.925627:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007982ab3d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1876035789399552:12345-0@lo:1000: 00000100:00100000:0.0:1789127247.925683:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007982ab3d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1876035789399552:12345-0@lo:1000: Request processed in 56us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127247.925689:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127247.925859:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876035789399552:0@lo:1000: 00000040:00080000:1.0:1789127247.926771:0:7452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000004:00080000:3.0:1789127247.926869:0:7477:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000922e0667 with version 0 00000020:00100000:3.0:1789127247.926891:0:7477:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789127247.927039:0:7477:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000003b504001 x1876035789399808/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127247.927117:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876035789399808:0@lo:1000: 00000100:00100000:3.0:1789127247.927156:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127247.927181:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 0000000077337324 going to sleep for 11 seconds 00000100:00100000:0.0:1789127247.927415:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789399808 00000100:00100000:0.0:1789127247.927421:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789399808 00000100:00100000:0.0:1789127247.927450:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127247.927456:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041f2c7e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1876035789399808:12345-0@lo:1000: 00000040:00080000:1.0:1789127247.930978:0:7452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789127247.931063:0:7452:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789127247.931660:0:7452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789127247.931942:0:7452:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1789127247.941142:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789127247.942224:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789127247.942462:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789127247.942635:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789127247.943713:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789127247.943976:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789127247.944134:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789127247.944296:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789127247.944729:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789127247.944924:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789127247.945053:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789127247.945196:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789127247.946299:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789127247.946616:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789127247.946753:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789127247.946902:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789127247.947194:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789127247.950458:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789127247.950776:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789127247.951069:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789127247.951197:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789127247.951660:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789127247.951795:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789127247.951985:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789127247.952127:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789127247.953205:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789127247.954974:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789127247.955176:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789127247.955910:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789127247.956091:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789127247.958033:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789127247.958341:0:7452:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789127247.958927:0:7452:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1789127247.964577:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:0.0:1789127247.964663:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:3.0:1789127247.968910:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041f2c7e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7477:x1876035789399808:12345-0@lo:1000: Request processed in 41447us (41747us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789127247.968926:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:1.0:1789127247.969152:0:7477:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:1.0:1789127247.969158:0:7477:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789127247.969174:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876035789399808:0@lo:1000: 00000100:00100000:1.0:1789127247.969268:0:7477:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b97942b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876035789399936:0@lo:1000: 00000100:00100000:1.0:1789127247.969323:0:7477:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127247.969353:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789399936 00000100:00100000:1.0:1789127247.969358:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789399936 00000100:00100000:1.0:1789127247.969395:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127247.969403:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a7851d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7477:x1876035789399936:12345-0@lo:1000: 00000100:00100000:1.0:1789127247.969466:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a7851d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7477:x1876035789399936:12345-0@lo:1000: Request processed in 63us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127247.969472:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127247.969530:0:7477:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b6b9395 going to sleep for 11 seconds 00000100:00100000:1.0:1789127247.969544:0:7477:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b97942b pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7477:1876035789399936:0@lo:1000: 00000040:00080000:1.0:1789127247.969563:0:7477:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:1.0:1789127247.969596:0:7477:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000eeddc313 with version 1 00000040:00080000:1.0:1789127247.971648:0:7477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789127247.971723:0:7477:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789127247.974156:0:7467:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000798bd60a version 1 rpc_version 1 00000020:00100000:2.0:1789127247.974200:0:7467:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789127247.974210:0:7467:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000508c153e x1876035789400192/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127247.974241:0:7467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7467:1876035789400192:0@lo:1000: 00000100:00100000:2.0:1789127247.974320:0:7467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127247.974380:0:7467:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028f66c51 going to sleep for 11 seconds 00000001:00080000:2.0:1789127247.975882:0:7452:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789127247.975917:0:7452:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb4b2418ff988 00100000:10000000:2.0:1789127247.975925:0:7452:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789127247.978406:0:7452:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789127247.978441:0:7452:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789127247.978476:0:7452:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789127247.978503:0:7452:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000100:00100000:1.0:1789127247.987127:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789400192 00000100:00100000:1.0:1789127247.987138:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789400192 00000100:00100000:1.0:1789127247.987189:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127247.987199:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002aec682 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876035789400192:12345-0@lo:1000: 00000100:00100000:1.0:1789127247.987446:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b9b4c3a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7476:x1876035789399040:12345-0@lo:700: Request processed in 61818us (68233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127247.987456:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789127247.987659:0:7476:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000b4b6354c x1876035789399040/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789127263 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127247.987676:0:7476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4b6354c pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7476:1876035789399040:0@lo:700: 40000000:02000000:2.0:1789127247.987690:0:7476:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:1.0:1789127248.002995:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1789127248.003113:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002aec682 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7467:x1876035789400192:12345-0@lo:1000: Request processed in 15914us (28790us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789127248.003127:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:1.0:1789127248.003178:0:7467:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1789127248.003183:0:7467:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789127248.003198:0:7467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7467:1876035789400192:0@lo:1000: 00000020:00000004:1.0:1789127248.008476:0:7452:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789127248.008690:0:7452:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1789127248.062444:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127248.067011:0:7476:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789127248.067087:0:7476:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1789127248.067094:0:7476:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:2.0:1789127248.823649:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127249.848899:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127250.879079:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127251.897854:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127252.921635:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127253.306037:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008cfc3632 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789400320:0@lo:400: 00000100:00100000:3.0:1789127253.306106:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127253.306161:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a733cab9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789400832:0@lo:41: 00000100:00100000:3.0:1789127253.306189:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127253.306213:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127253.306218:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d8f5c721 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789400448:0@lo:400: 00000100:00100000:0.0:1789127253.306251:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789400320 00000100:00100000:3.0:1789127253.306259:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127253.306259:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789400320 00000100:00100000:3.0:1789127253.306299:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003cd0b9ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789400704:0@lo:400: 00000100:00100000:0.0:1789127253.306314:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789127253.306323:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008265f841 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:3652:x1876035789400320:12345-0@lo:400: 00000100:00100000:3.0:1789127253.306343:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127253.306371:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008265f841 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:3652:x1876035789400320:12345-0@lo:400: Request processed in 50us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127253.306375:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127253.306378:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789127253.306379:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789400576:0@lo:400: 00000100:00100000:3.0:1789127253.306398:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127253.306423:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789400448 00000100:00100000:3.0:1789127253.306426:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789400448 00000100:00100000:3.0:1789127253.306464:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789400704 00000100:00100000:3.0:1789127253.306467:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789400704 00000100:00100000:3.0:1789127253.306481:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127253.306492:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002449c5f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789400448:12345-0@lo:400: 00000100:00100000:3.0:1789127253.306541:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002449c5f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789400448:12345-0@lo:400: Request processed in 49us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127253.306547:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127253.306559:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127253.306564:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bc885688 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789400704:12345-0@lo:400: 00000100:00100000:3.0:1789127253.306592:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bc885688 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789400704:12345-0@lo:400: Request processed in 29us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127253.306598:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789127253.306629:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000003cd0b9ed x1876035789400704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127253.306643:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003cd0b9ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789400704:0@lo:400: 00010000:00080000:3.0:1789127253.306674:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000d8f5c721 x1876035789400448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127253.306696:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d8f5c721 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789400448:0@lo:400: 00000100:00100000:3.0:1789127253.306707:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008cfc3632 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789400320:0@lo:400: 00000100:00100000:1.0:1789127253.306797:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789400832 00000100:00100000:1.0:1789127253.306802:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789400832 00000100:00100000:1.0:1789127253.306823:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789400576 00000100:00100000:1.0:1789127253.306825:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789400576 00000100:00100000:1.0:1789127253.306837:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789127253.306842:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000885bcf2e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1876035789400832:12345-0@lo:41: 00000004:00000024:1.0:1789127253.306869:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1789127253.306915:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000885bcf2e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3652:x1876035789400832:12345-0@lo:41: Request processed in 73us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127253.306932:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789127253.306960:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127253.306966:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067c6e67f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789400576:12345-0@lo:400: 00000100:00100000:1.0:1789127253.307002:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067c6e67f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789400576:12345-0@lo:400: Request processed in 37us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127253.307009:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127253.307040:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b504001 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789400576:0@lo:400: 00000100:00100000:3.0:1789127253.310099:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a733cab9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789400832:0@lo:41: 00000001:02000400:2.0:1789127253.562021:0:7722:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1789127253.830641:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789127253.830650:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9346b640b000 from 4 10000000:01000000:1.0:1789127253.830656:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789127253.830708:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000595924c0/0xd718aadfd785d22c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127253.830721:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000595924c0/0xd718aadfd785d22c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127253.830882:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000595924c0/0xd718aadfd785d22c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127253.830910:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005870bbc8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789400960:0@lo:101: 00000100:00100000:1.0:1789127253.831001:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127253.831043:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789400960 00000100:00100000:1.0:1789127253.831050:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789400960 00000100:00100000:1.0:1789127253.831104:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789127253.831112:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000003fd8c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:6520:x1876035789400960:12345-0@lo:101: 00010000:00010000:1.0:1789127253.831125:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127253.831138:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e29f8cdb/0xd718aadfd785d233 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d22c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127253.831170:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e29f8cdb/0xd718aadfd785d233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d22c expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127253.831179:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e29f8cdb/0xd718aadfd785d233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d22c expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127253.831187:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e29f8cdb, rc 0) 00000100:00100000:1.0:1789127253.831218:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000003fd8c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:6520:x1876035789400960:12345-0@lo:101: Request processed in 107us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127253.831224:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789127253.831396:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 000000001db2a72d going to sleep for 11 seconds 00000100:00100000:1.0:1789127253.831419:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005870bbc8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789400960:0@lo:101: 00010000:00010000:1.0:1789127253.831434:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000595924c0/0xd718aadfd785d22c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d233 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127253.831442:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000595924c0/0xd718aadfd785d22c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d233 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127253.831491:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005870bbc8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789401088:0@lo:256: 00000100:00100000:1.0:1789127253.832395:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127253.832421:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 000000001db2a72d going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.834416:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789401088 00000100:00100000:2.0:1789127253.834428:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789401088 00000100:00100000:2.0:1789127253.834483:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789127253.834492:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000589cc921 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:6520:x1876035789401088:12345-0@lo:256: 20000000:01000000:2.0:1789127253.834530:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789127253.834546:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789127253.834550:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789127253.834675:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000589cc921 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:6520:x1876035789401088:12345-0@lo:256: Request processed in 184us (2281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127253.834682:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789127253.834782:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005870bbc8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789401088:0@lo:256: 10000000:01000000:2.0:1789127253.834838:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789127253.834848:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000595924c0/0xd718aadfd785d22c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d233 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.834864:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000595924c0/0xd718aadfd785d22c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d233 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127253.834874:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789127253.834876:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff934687bf9800 from 21 10000000:01000000:2.0:1789127253.834878:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789127253.834907:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 000000004518f571/0xd718aadfd785d23a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.834914:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 000000004518f571/0xd718aadfd785d23a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.834921:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 000000004518f571/0xd718aadfd785d23a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127253.834937:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789401216:0@lo:101: 00000100:00100000:2.0:1789127253.834979:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127253.835242:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099276f83 going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.835261:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789401216 00000100:00100000:2.0:1789127253.835265:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789401216 00000100:00100000:2.0:1789127253.835368:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789127253.835374:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ddc9919 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:6520:x1876035789401216:12345-0@lo:101: 00010000:00010000:2.0:1789127253.835383:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127253.835393:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000020a3c7f2/0xd718aadfd785d241 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d23a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.835412:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000020a3c7f2/0xd718aadfd785d241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d23a expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.835433:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000020a3c7f2/0xd718aadfd785d241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d23a expref: 15 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.835440:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000020a3c7f2, rc 0) 00000100:00100000:2.0:1789127253.835471:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ddc9919 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:6520:x1876035789401216:12345-0@lo:101: Request processed in 98us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127253.835477:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789127253.835530:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789401216:0@lo:101: 00010000:00010000:2.0:1789127253.835542:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 000000004518f571/0xd718aadfd785d23a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d241 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.835550:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 000000004518f571/0xd718aadfd785d23a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d241 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127253.835605:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789401344:0@lo:501: 00000100:00100000:2.0:1789127253.835630:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127253.835644:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099276f83 going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.835655:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789401344 00000100:00100000:2.0:1789127253.835659:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789401344 00000100:00100000:2.0:1789127253.835679:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789127253.835684:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000010b4a90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:6520:x1876035789401344:12345-0@lo:501: 00000100:00100000:2.0:1789127253.837491:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000010b4a90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:6520:x1876035789401344:12345-0@lo:501: Request processed in 1802us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127253.837504:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789127253.837581:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789401344:0@lo:501: 00000100:00100000:2.0:1789127253.837625:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789401472:0@lo:503: 00000100:00100000:2.0:1789127253.837673:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127253.837695:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099276f83 going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.837712:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789401472 00000100:00100000:2.0:1789127253.837716:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789401472 00000100:00100000:2.0:1789127253.837751:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789127253.837758:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011fb0262 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:6520:x1876035789401472:12345-0@lo:503: 00000100:00100000:2.0:1789127253.837844:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011fb0262 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:6520:x1876035789401472:12345-0@lo:503: Request processed in 86us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127253.837851:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789127253.837887:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789401472:0@lo:503: 00000100:00100000:0.0:1789127253.859923:0:7738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000958846a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:7738:1876035789401600:0@lo:502: 00000100:00100000:0.0:1789127253.861564:0:7738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127253.861608:0:7738:0:(client.c:2715:ptlrpc_set_wait()) set 000000001db48128 going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.861682:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789401600 00000100:00100000:2.0:1789127253.861690:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789401600 00000100:00100000:2.0:1789127253.861748:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789127253.861755:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1310144 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7738:x1876035789401600:12345-0@lo:502: 00000100:00100000:2.0:1789127253.861874:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1310144 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7738:x1876035789401600:12345-0@lo:502: Request processed in 119us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127253.861881:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789127253.862967:0:7738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000958846a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:7738:1876035789401600:0@lo:502: 00000100:00100000:0.0:1789127253.863933:0:7738:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000958846a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:7738:1876035789401728:0@lo:502: 00000100:00100000:0.0:1789127253.864942:0:7738:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127253.867528:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789401728 00000100:00100000:2.0:1789127253.867541:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789401728 00000100:00100000:2.0:1789127253.867587:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789127253.867594:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af2df382 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7738:x1876035789401728:12345-0@lo:502: 00000100:00100000:2.0:1789127253.867721:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af2df382 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:7738:x1876035789401728:12345-0@lo:502: Request processed in 128us (2782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127253.867729:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789127253.880220:0:7738:0:(client.c:2715:ptlrpc_set_wait()) set 000000001db48128 going to sleep for 11 seconds 00000100:00100000:0.0:1789127253.880284:0:7738:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000958846a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:7738:1876035789401728:0@lo:502: 00000040:00080000:0.0:1789127253.880330:0:7738:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1789127253.892218:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789127253.892265:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789127253.892492:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 000000004518f571/0xd718aadfd785d23a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d241 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.892532:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 000000004518f571/0xd718aadfd785d23a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d241 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127253.892543:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789127253.892546:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff934687bf9800 from 4 10000000:01000000:2.0:1789127253.892549:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789127253.892588:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000101157bf/0xd718aadfd785d248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.892595:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000101157bf/0xd718aadfd785d248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.892603:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000101157bf/0xd718aadfd785d248 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127253.892627:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789401856:0@lo:101: 00000100:00100000:2.0:1789127253.892692:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127253.893414:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b514253f going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.893437:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789401856 00000100:00100000:2.0:1789127253.893444:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789401856 00000100:00100000:2.0:1789127253.893491:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789127253.893501:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfab39c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:6520:x1876035789401856:12345-0@lo:101: 00010000:00010000:2.0:1789127253.893536:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127253.893551:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000007d69f2e/0xd718aadfd785d24f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d248 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.893576:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000007d69f2e/0xd718aadfd785d24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d248 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.893599:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000007d69f2e/0xd718aadfd785d24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d248 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.893606:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000007d69f2e, rc 0) 00000100:00100000:2.0:1789127253.893656:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfab39c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789401856:12345-0@lo:101: Request processed in 157us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127253.893663:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789127253.893712:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789401856:0@lo:101: 00010000:00010000:2.0:1789127253.893728:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000101157bf/0xd718aadfd785d248 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d24f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.894617:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000101157bf/0xd718aadfd785d248 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d24f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127253.894683:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789401984:0@lo:256: 00000100:00100000:2.0:1789127253.894732:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127253.894758:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b514253f going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.896742:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789401984 00000100:00100000:2.0:1789127253.896753:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789401984 00000100:00100000:2.0:1789127253.896801:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789127253.896823:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4fa45a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789401984:12345-0@lo:256: 20000000:01000000:2.0:1789127253.896847:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789127253.896866:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789127253.896869:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789127253.897457:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4fa45a6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789401984:12345-0@lo:256: Request processed in 648us (2724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127253.897466:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789127253.897546:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789401984:0@lo:256: 10000000:01000000:2.0:1789127253.897596:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789127253.897604:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000101157bf/0xd718aadfd785d248 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d24f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.897613:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000101157bf/0xd718aadfd785d248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d24f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127253.897622:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789127253.897625:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789127253.897627:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789127253.897655:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000ca7a4b38/0xd718aadfd785d256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.897661:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000ca7a4b38/0xd718aadfd785d256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.897668:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000ca7a4b38/0xd718aadfd785d256 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127253.897684:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789402112:0@lo:101: 00000100:00100000:2.0:1789127253.897716:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127253.897742:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b514253f going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.897756:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789402112 00000100:00100000:2.0:1789127253.897760:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789402112 00000100:00100000:2.0:1789127253.897787:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789127253.897793:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009483c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789402112:12345-0@lo:101: 00010000:00010000:2.0:1789127253.897802:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127253.897825:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c5007eca/0xd718aadfd785d25d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d256 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.897852:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c5007eca/0xd718aadfd785d25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d256 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.897861:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c5007eca/0xd718aadfd785d25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d256 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.897870:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c5007eca, rc 0) 00000100:00100000:2.0:1789127253.897897:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009483c53f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789402112:12345-0@lo:101: Request processed in 105us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127253.897904:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789127253.897935:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789402112:0@lo:101: 00010000:00010000:2.0:1789127253.897956:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000ca7a4b38/0xd718aadfd785d256 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d25d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.897964:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000ca7a4b38/0xd718aadfd785d256 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d25d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127253.898028:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789402240:0@lo:501: 00000100:00100000:2.0:1789127253.898052:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127253.898065:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b514253f going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.898076:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789402240 00000100:00100000:2.0:1789127253.898079:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789402240 00000100:00100000:2.0:1789127253.898102:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789127253.898108:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007399101e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789402240:12345-0@lo:501: 00000100:00100000:2.0:1789127253.898208:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007399101e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789402240:12345-0@lo:501: Request processed in 100us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127253.898215:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789127253.898250:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789402240:0@lo:501: 00000100:00100000:2.0:1789127253.898292:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789402368:0@lo:503: 00000100:00100000:2.0:1789127253.898330:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127253.898343:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b514253f going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.898354:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789402368 00000100:00100000:2.0:1789127253.898357:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789402368 00000100:00100000:2.0:1789127253.898378:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127253.898384:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ddec55c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789402368:12345-0@lo:503: 00000100:00100000:2.0:1789127253.898459:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ddec55c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789402368:12345-0@lo:503: Request processed in 75us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127253.898472:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127253.898538:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789402368:0@lo:503: 00000100:00100000:2.0:1789127253.901545:0:7741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:7741:1876035789402496:0@lo:502: 00000100:00100000:2.0:1789127253.901622:0:7741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127253.901660:0:7741:0:(client.c:2715:ptlrpc_set_wait()) set 0000000028f66c51 going to sleep for 11 seconds 00000100:00100000:3.0:1789127253.901730:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789402496 00000100:00100000:3.0:1789127253.901737:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789402496 00000100:00100000:3.0:1789127253.901778:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789127253.901785:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000beae99d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:7741:x1876035789402496:12345-0@lo:502: 00000100:00100000:3.0:1789127253.901921:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000beae99d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:7741:x1876035789402496:12345-0@lo:502: Request processed in 135us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127253.901929:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789127253.902124:0:7741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:7741:1876035789402496:0@lo:502: 00000020:01000000:2.0:1789127253.902153:0:7741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127253.902163:0:7741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127253.902166:0:7741:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789127253.902171:0:7741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789127253.902174:0:7741:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:00000080:2.0:1789127253.902195:0:7741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789127253.902210:0:7741:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000001cc00e10) 00000020:00000080:2.0:1789127253.902228:0:7741:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1789127253.902235:0:7741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789127253.902337:0:7741:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789127253.902342:0:7741:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789127253.902356:0:7741:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785d26b 00010000:00080000:2.0:1789127253.902387:0:7741:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c6289e94@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:2.0:1789127253.910751:0:7741:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1789127253.915503:0:7741:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789127253.915576:0:7741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789127253.915615:0:7741:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789127253.915636:0:7741:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd718aadfd785d272 00000100:00080000:2.0:1789127253.915647:0:7741:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127253.915652:0:7741:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000c6289e94 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789127253.915685:0:7741:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a33db54b x1876035789402624/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127253.915713:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789402624:0@lo:38: 00000100:00100000:2.0:1789127253.915787:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789127253.915839:0:7741:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1789127253.915940:0:7741:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:0.0:1789127253.916110:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789402624 00000100:00100000:0.0:1789127253.916117:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789402624 00000100:00100000:0.0:1789127253.916147:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127253.916153:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003854b000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1876035789402624:12345-0@lo:38: 00010000:00080000:0.0:1789127253.916176:0:6528:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:0.0:1789127253.916205:0:6528:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd718aadfd785d279 00000004:00100000:0.0:1789127253.916218:0:6528:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789127253.916224:0:6528:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789127253.916502:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c43a250f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789402880:0@lo:400: 00000100:00100000:1.0:1789127253.916564:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127253.916582:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127253.916588:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789403008:0@lo:400: 00000100:00100000:1.0:1789127253.916615:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127253.916657:0:6527:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789127253.916665:0:6527:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1789127253.917108:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf3d5000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789402752:0@lo:400: 00000100:00100000:3.0:1789127253.917143:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127253.917184:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789403008 00000100:00100000:3.0:1789127253.917190:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789403008 00000100:00100000:3.0:1789127253.917225:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789402752 00000100:00100000:3.0:1789127253.917228:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789402752 00000100:00100000:3.0:1789127253.917243:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127253.917250:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd938b3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789403008:12345-0@lo:400: 00000100:00100000:3.0:1789127253.917368:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd938b3f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789403008:12345-0@lo:400: Request processed in 119us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127253.917377:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127253.917393:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127253.917399:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027d4094c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789402752:12345-0@lo:400: 00000100:00100000:3.0:1789127253.917431:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027d4094c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789402752:12345-0@lo:400: Request processed in 33us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127253.917437:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789127253.917470:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000508c153e x1876035789403008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127253.917484:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000508c153e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789403008:0@lo:400: 00010000:00080000:3.0:1789127253.917539:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000bf3d5000 x1876035789402752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127253.917549:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf3d5000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789402752:0@lo:400: 00000100:00080000:0.0:1789127253.919321:0:7744:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000d22b06e7 x1876035789403136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127253.919334:0:7744:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1118c61 going to sleep for 0 seconds 00000020:01000000:2.0:1789127253.919734:0:7741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127253.919740:0:7741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127253.919743:0:7741:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789127253.919746:0:7741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127253.919749:0:7741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127253.919751:0:7741:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789127253.919754:0:7741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789127253.919756:0:7741:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789127253.919781:0:7741:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf3d5000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:7741:1876035789403264:0@lo:502: 00000100:00100000:2.0:1789127253.919849:0:7741:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127253.919888:0:7741:0:(client.c:2715:ptlrpc_set_wait()) set 0000000060fd4a99 going to sleep for 11 seconds 00000100:00100000:3.0:1789127253.920207:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789403264 00000100:00100000:3.0:1789127253.920215:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789403264 00000100:00100000:3.0:1789127253.920254:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789127253.920262:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000064f010fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:7741:x1876035789403264:12345-0@lo:502: 00000100:00100000:3.0:1789127253.920566:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000064f010fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:7741:x1876035789403264:12345-0@lo:502: Request processed in 304us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127253.920574:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789127253.920790:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789402880 00000100:00100000:1.0:1789127253.920796:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789402880 00000100:00100000:0.0:1789127253.921501:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127253.921532:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a594a0eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789402880:12345-0@lo:400: 00000100:00100000:0.0:1789127253.921592:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a594a0eb pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789402880:12345-0@lo:400: Request processed in 82us (5028us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127253.921599:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127253.922191:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c43a250f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789402880:0@lo:400: 00000100:00080000:0.0:1789127253.929307:0:6528:0:(import.c:65:import_set_state_nolock()) 000000001d770b7c : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127253.929410:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003854b000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1876035789402624:12345-0@lo:38: Request processed in 13255us (13622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127253.929421:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127253.929652:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127253.929663:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789127253.929671:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789127253.929676:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789127253.929678:0:3649:0:(import.c:65:import_set_state_nolock()) 00000000c6289e94 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789127253.929705:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000c1118c61): req@00000000d22b06e7 x1876035789403136/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127253.929721:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789402624:0@lo:38: 00000100:00100000:3.0:1789127253.929791:0:7744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127253.929821:0:7744:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c1118c61 going to sleep for 11 seconds 00000100:00100000:1.0:1789127253.930163:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789403136 00000100:00100000:1.0:1789127253.930171:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789403136 00000100:00100000:1.0:1789127253.930211:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127253.930218:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000643d6c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7744:x1876035789403136:12345-0@lo:1000: 00000100:00100000:3.0:1789127253.930631:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000958846a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789403392:0@lo:41: 00000100:00100000:3.0:1789127253.930668:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127253.930843:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789403392 00000100:00100000:3.0:1789127253.930860:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789403392 00000100:00100000:3.0:1789127253.930898:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127253.930904:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000069662de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3652:x1876035789403392:12345-0@lo:41: 00000004:00000024:3.0:1789127253.930928:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789127253.931375:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000069662de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3652:x1876035789403392:12345-0@lo:41: Request processed in 471us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127253.931382:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127253.931427:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000958846a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789403392:0@lo:41: 00000100:00100000:1.0:1789127253.931532:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000643d6c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7744:x1876035789403136:12345-0@lo:1000: Request processed in 1314us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127253.931539:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127253.931848:0:7744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d22b06e7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7744:1876035789403136:0@lo:1000: 00000040:01000000:3.0:1789127253.931882:0:7744:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789127253.931919:0:7744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8aa0990 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7744:1876035789403520:0@lo:1000: 00000100:00100000:3.0:1789127253.931967:0:7744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127253.932168:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789403520 00000100:00100000:0.0:1789127253.932174:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789403520 00000100:00100000:0.0:1789127253.932209:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127253.932216:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c46c3b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7744:x1876035789403520:12345-0@lo:1000: 00000100:00100000:0.0:1789127253.932398:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c46c3b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7744:x1876035789403520:12345-0@lo:1000: Request processed in 183us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127253.932405:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789127253.932590:0:7744:0:(client.c:2715:ptlrpc_set_wait()) set 00000000978f8eaa going to sleep for 11 seconds 00000100:00100000:3.0:1789127253.932607:0:7744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8aa0990 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7744:1876035789403520:0@lo:1000: 00000100:00100000:3.0:1789127253.932650:0:7744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a8aa0990 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7744:1876035789403648:0@lo:700: 00000100:00100000:3.0:1789127253.932676:0:7744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127253.932836:0:7741:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf3d5000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:7741:1876035789403264:0@lo:502: 00000020:01000000:2.0:1789127253.932871:0:7741:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127253.932879:0:7741:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127253.932887:0:7741:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789127253.932891:0:7741:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1789127253.933797:0:7744:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8656765 going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.933931:0:6531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789403648 00000100:00100000:2.0:1789127253.933937:0:6531:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789403648 00000100:00100000:2.0:1789127253.934145:0:6531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127253.934155:0:6531:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6414c2a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7744:x1876035789403648:12345-0@lo:700: 00000100:00100000:2.0:1789127253.935187:0:6531:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6414c2a pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7744:x1876035789403648:12345-0@lo:700: Request processed in 1030us (2507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127253.935197:0:6531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:3.0:1789127253.935373:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1789127253.935404:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789127253.935412:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000ca7a4b38/0xd718aadfd785d256 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d25d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127253.935422:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000ca7a4b38/0xd718aadfd785d256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d25d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127253.935432:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789127253.935435:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9346b18f3490 from 1 10000000:01000000:3.0:1789127253.935437:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789127253.935474:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000ce6a1726/0xd718aadfd785d280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127253.935482:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000ce6a1726/0xd718aadfd785d280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127253.935491:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000ce6a1726/0xd718aadfd785d280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127253.935538:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ae5030cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789403776:0@lo:101: 00000100:00100000:3.0:1789127253.935583:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127253.935616:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 00000000978f8eaa going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.936014:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789403776 00000100:00100000:2.0:1789127253.936021:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789403776 00000100:00100000:2.0:1789127253.936052:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789127253.936058:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000258057d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789403776:12345-0@lo:101: 00010000:00010000:2.0:1789127253.936068:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127253.936079:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a1dc2ac5/0xd718aadfd785d287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d280 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.936099:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a1dc2ac5/0xd718aadfd785d287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d280 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.936108:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a1dc2ac5/0xd718aadfd785d287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d280 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.936115:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a1dc2ac5, rc 0) 00000100:00100000:2.0:1789127253.936147:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000258057d0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789403776:12345-0@lo:101: Request processed in 89us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127253.936153:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789127253.936187:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ae5030cb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789403776:0@lo:101: 00010000:00010000:2.0:1789127253.936199:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000ce6a1726/0xd718aadfd785d280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d287 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.936212:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000ce6a1726/0xd718aadfd785d280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d287 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127253.936266:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bf3d5000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789403904:0@lo:501: 00000100:00100000:2.0:1789127253.936307:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127253.936320:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 0000000024f7c4bf going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.936332:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789403904 00000100:00100000:2.0:1789127253.936335:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789403904 00000100:00100000:2.0:1789127253.936353:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789127253.936358:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000436bce30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789403904:12345-0@lo:501: 00000100:00100000:2.0:1789127253.936416:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000436bce30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789403904:12345-0@lo:501: Request processed in 58us (108us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127253.936422:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789127253.936445:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bf3d5000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789403904:0@lo:501: 10000000:01000000:2.0:1789127253.936464:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789127253.936467:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: 00000000ce6a1726/0xd718aadfd785d280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d287 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127253.936474:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: 00000000ce6a1726/0xd718aadfd785d280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d287 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127253.940159:0:7744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a8aa0990 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7744:1876035789403648:0@lo:700: 00000100:00100000:0.0:1789127253.940463:0:7744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d22b06e7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7744:1876035789404032:0@lo:1000: 00000100:00100000:0.0:1789127253.940673:0:7744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127253.940709:0:7744:0:(client.c:2715:ptlrpc_set_wait()) set 000000007b32bb30 going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.940781:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789404032 00000100:00100000:2.0:1789127253.940788:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789404032 00000100:00100000:2.0:1789127253.940837:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127253.940845:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000958846a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7744:x1876035789404032:12345-0@lo:1000: 00000100:00100000:2.0:1789127253.940935:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000958846a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7744:x1876035789404032:12345-0@lo:1000: Request processed in 90us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127253.940960:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789127253.941038:0:7744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d22b06e7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7744:1876035789404032:0@lo:1000: 00000004:00080000:3.0:1789127253.941080:0:7744:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000f7f50fe9 with version 0 00000020:00100000:3.0:1789127253.941095:0:7744:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1789127253.941101:0:7744:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004b877497 x1876035789404288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127253.941115:0:7744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b877497 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7744:1876035789404288:0@lo:1000: 00000100:00100000:3.0:1789127253.941146:0:7744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127253.941169:0:7744:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e641950b going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.941285:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789404288 00000100:00100000:2.0:1789127253.941289:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789404288 00000100:00100000:2.0:1789127253.941319:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789127253.941326:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000981c6434 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7744:x1876035789404288:12345-0@lo:1000: 00000001:00080000:3.0:1789127253.944865:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1789127253.944878:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789127253.945058:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000981c6434 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7744:x1876035789404288:12345-0@lo:1000: Request processed in 3729us (3908us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789127253.945071:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1789127253.945284:0:7744:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1789127253.945289:0:7744:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789127253.945305:0:7744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b877497 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7744:1876035789404288:0@lo:1000: 00000100:00100000:3.0:1789127253.945389:0:7744:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004b877497 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7744:1876035789404416:0@lo:1000: 00000100:00100000:3.0:1789127253.945426:0:7744:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127253.945466:0:7744:0:(client.c:2715:ptlrpc_set_wait()) set 0000000047f3e710 going to sleep for 11 seconds 00000100:00100000:0.0:1789127253.945591:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789404416 00000100:00100000:0.0:1789127253.945598:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789404416 00000100:00100000:0.0:1789127253.945634:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127253.945640:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b68438 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7744:x1876035789404416:12345-0@lo:1000: 00000100:00100000:0.0:1789127253.945701:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b68438 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7744:x1876035789404416:12345-0@lo:1000: Request processed in 62us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127253.945708:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127253.945774:0:7744:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004b877497 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7744:1876035789404416:0@lo:1000: 00000040:00080000:3.0:1789127253.945789:0:7744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789127253.945815:0:7744:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 00000000e641950b with version 1 00010000:00010000:2.0:1789127253.947206:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789127253.947293:0:7742:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000b090b83c version 1 rpc_version 1 00000020:00100000:0.0:1789127253.947324:0:7742:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789127253.947341:0:7742:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000007c939c12 x1876035789404672/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127253.947359:0:7742:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7742:1876035789404672:0@lo:1000: 00000100:00100000:0.0:1789127253.947407:0:7742:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127253.947439:0:7742:0:(client.c:2715:ptlrpc_set_wait()) set 0000000096c8c0ed going to sleep for 11 seconds 00000100:00100000:2.0:1789127253.947558:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789404672 00000100:00100000:2.0:1789127253.947564:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789404672 00000100:00100000:2.0:1789127253.947603:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127253.947611:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a733cab9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7742:x1876035789404672:12345-0@lo:1000: 00000001:00080000:2.0:1789127253.949244:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000040:00080000:3.0:1789127253.950407:0:7744:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789127253.950486:0:7744:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789127253.950492:0:7744:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:1.0:1789127253.956895:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a733cab9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7742:x1876035789404672:12345-0@lo:1000: Request processed in 9278us (9481us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789127253.956911:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:0.0:1789127253.958354:0:7742:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789127253.958362:0:7742:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789127253.958381:0:7742:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c939c12 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7742:1876035789404672:0@lo:1000: 00000020:00000004:1.0:1789127254.859797:0:7780:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789127254.861286:0:7780:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789127254.968228:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127255.993291:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127257.025160:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127258.041595:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789127258.251170:0:7882:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127258.251385:0:7882:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789127258.430018:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008733985b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789404800:0@lo:41: 00000100:00100000:0.0:1789127258.430137:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127258.430205:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789404800 00000100:00100000:0.0:1789127258.430212:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789404800 00000100:00100000:0.0:1789127258.430267:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127258.430275:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b517e5c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789404800:12345-0@lo:41: 00000004:00000024:0.0:1789127258.430306:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:0.0:1789127258.430349:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b517e5c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789404800:12345-0@lo:41: Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127258.430357:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127258.430400:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008733985b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789404800:0@lo:41: 00000100:00100000:1.0:1789127258.935953:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007b97942b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789405184:0@lo:400: 00000100:00100000:1.0:1789127258.936084:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127258.936140:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127258.936146:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007188dbbf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789405312:0@lo:400: 00000100:00100000:1.0:1789127258.936193:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127258.936233:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789405184 00000100:00100000:1.0:1789127258.936239:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789405184 00000100:00100000:1.0:1789127258.936299:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789127258.936307:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ec8a475 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789405184:12345-0@lo:400: 00000100:00100000:1.0:1789127258.936357:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ec8a475 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789405184:12345-0@lo:400: Request processed in 51us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127258.936365:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789127258.936386:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789405312 00000100:00100000:1.0:1789127258.936396:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789405312 00000100:00100000:1.0:1789127258.936425:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127258.936430:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d751e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789405312:12345-0@lo:400: 00000100:00100000:1.0:1789127258.936460:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d751e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789405312:12345-0@lo:400: Request processed in 31us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127258.936466:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789127258.936502:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000007188dbbf x1876035789405312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127258.936545:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007188dbbf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789405312:0@lo:400: 00000100:00100000:1.0:1789127258.936558:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007b97942b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789405184:0@lo:400: 00000100:00100000:0.0:1789127258.936948:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005870bbc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789405056:0@lo:400: 00000100:00100000:0.0:1789127258.936985:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127258.937009:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789127258.937014:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000077ef1fba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789404928:0@lo:400: 00000100:00100000:0.0:1789127258.937039:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127258.937061:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000050285643 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789405440:0@lo:400: 00000100:00100000:0.0:1789127258.937092:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127258.937121:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789405440 00000100:00100000:0.0:1789127258.937126:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789405440 00000100:00100000:0.0:1789127258.937154:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127258.937161:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000039983bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789405440:12345-0@lo:400: 00000100:00100000:0.0:1789127258.937211:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000039983bc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789405440:12345-0@lo:400: Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127258.937218:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127258.937235:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789405056 00000100:00100000:0.0:1789127258.937257:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789405056 00000100:00100000:0.0:1789127258.937282:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127258.937288:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f6414ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789405056:12345-0@lo:400: 00000100:00100000:0.0:1789127258.937318:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f6414ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789405056:12345-0@lo:400: Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127258.937323:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127258.937340:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789404928 00000100:00100000:0.0:1789127258.937344:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789404928 00000100:00100000:0.0:1789127258.937369:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789127258.937374:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d7f253ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:3651:x1876035789404928:12345-0@lo:400: 00000100:00100000:0.0:1789127258.937405:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d7f253ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:3651:x1876035789404928:12345-0@lo:400: Request processed in 31us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127258.937410:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789127258.937457:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000077ef1fba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789404928:0@lo:400: 00000100:00100000:0.0:1789127258.937468:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000050285643 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789405440:0@lo:400: 00010000:00080000:0.0:1789127258.937483:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005870bbc8 x1876035789405056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127258.937504:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005870bbc8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789405056:0@lo:400: 00000100:00100000:2.0:1789127258.943224:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000061243200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789405568:0@lo:41: 00000100:00100000:2.0:1789127258.943320:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127258.943419:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789405568 00000100:00100000:0.0:1789127258.943430:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789405568 00000100:00100000:0.0:1789127258.943487:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127258.943496:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf3d5000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789405568:12345-0@lo:41: 00000004:00000024:0.0:1789127258.943555:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789127258.943606:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf3d5000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789405568:12345-0@lo:41: Request processed in 112us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127258.943612:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127258.944429:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000061243200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789405568:0@lo:41: 00010000:00010000:3.0:1789127259.071181:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789127259.740324:0:7930:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcce64450 20000000:00000080:0.0:1789127259.740861:0:7930:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9346b6603c00 uarg=0000000000000000 20000000:01000000:0.0:1789127259.741036:0:7930:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789127259.741043:0:7930:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789127259.741047:0:7930:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789127259.741118:0:7930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789127259.741129:0:7930:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789127259.752127:0:7930:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127259.752382:0:7930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789127259.752411:0:7930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789127259.752430:0:7930:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789127259.752444:0:7930:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789127259.752460:0:7930:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127259.752477:0:7930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b4ddaf5d/0xd718aadfd785d10d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d106 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127259.752483:0:7930:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c1509ad7/0xd718aadfd785d1fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d1f4 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127259.752494:0:7930:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127259.752568:0:7930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c1509ad7/0xd718aadfd785d1fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d1f4 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127259.753438:0:7930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c1509ad7/0xd718aadfd785d1fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d1f4 expref: 17 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127259.753455:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d22b06e7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1876035789405696:0@lo:104: 00000100:00100000:1.0:1789127259.759348:0:7930:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127259.759428:0:7930:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b4ddaf5d/0xd718aadfd785d10d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d106 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127259.759443:0:7930:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b4ddaf5d/0xd718aadfd785d10d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d106 expref: 17 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127259.759457:0:7930:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000036849b8a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1876035789405824:0@lo:104: 00000100:00100000:1.0:1789127259.759481:0:7930:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ddffc98 going to sleep for 11 seconds 00000100:00100000:2.0:1789127259.759892:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789127259.759912:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127259.759938:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789405696 00000100:00100000:2.0:1789127259.759945:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789405696 00000100:00100000:2.0:1789127259.759979:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789405824 00000100:00100000:2.0:1789127259.759982:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789405824 00000100:00100000:2.0:1789127259.759996:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127259.760003:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb67873b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:7930:x1876035789405696:12345-0@lo:104: 00010000:00010000:2.0:1789127259.760017:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d1fb expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127259.760079:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789127259.760095:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb67873b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:7930:x1876035789405696:12345-0@lo:104: Request processed in 91us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127259.760102:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127259.760140:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789127259.760145:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000508c153e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:7930:x1876035789405824:12345-0@lo:104: 00010000:00010000:2.0:1789127259.760151:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d10d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127259.760182:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789127259.760186:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000508c153e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:7930:x1876035789405824:12345-0@lo:104: Request processed in 43us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127259.760192:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:3.0:1789127259.760446:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127259.760452:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d1fb expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.760459:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d905e226 already unused, calling callback (000000001e5df574) 10000000:00010000:3.0:1789127259.760462:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d1fb expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.760469:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d1fb expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127259.760475:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d1fb expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127259.760480:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789127259.760542:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d1fb expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.760549:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127259.760594:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d1fb expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.760602:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 00000000d905e226/0xd718aadfd785d1f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d1fb expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.760615:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127259.760618:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d10d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.760623:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009835e9cb already unused, calling callback (000000001e5df574) 10000000:00010000:3.0:1789127259.760625:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d10d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.760631:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d10d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127259.760636:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d10d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127259.760641:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789127259.760654:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d10d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.760659:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127259.760664:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d10d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.760668:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: 000000009835e9cb/0xd718aadfd785d106 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d10d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.760680:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127259.760689:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127259.760690:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127259.760696:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127259.760708:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000272dfbb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789406080:0@lo:103: 00000100:00100000:3.0:1789127259.760742:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127259.760775:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127259.760780:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cd3cbb22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789405952:0@lo:103: 00000100:00100000:3.0:1789127259.760800:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127259.760824:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789406080 00000100:00100000:3.0:1789127259.760829:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789406080 00010000:00010000:3.0:1789127259.760849:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b4ddaf5d/0xd718aadfd785d10d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d106 expref: 18 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127259.760870:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789405952 00000100:00100000:3.0:1789127259.760873:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789405952 00010000:00010000:3.0:1789127259.760882:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c1509ad7/0xd718aadfd785d1fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d1f4 expref: 19 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127259.760895:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127259.760900:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008733985b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:3653:x1876035789406080:12345-0@lo:103: 00010000:00010000:3.0:1789127259.760909:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127259.760913:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b4ddaf5d/0xd718aadfd785d10d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d106 expref: 19 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.760921:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b4ddaf5d/0xd718aadfd785d10d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d106 expref: 19 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.760935:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127259.760962:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008733985b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:3653:x1876035789406080:12345-0@lo:103: Request processed in 62us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127259.760977:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127259.760991:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127259.760996:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009c519a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:3653:x1876035789405952:12345-0@lo:103: 00010000:00010000:3.0:1789127259.761004:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127259.761007:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c1509ad7/0xd718aadfd785d1fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d1f4 expref: 18 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.761016:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c1509ad7/0xd718aadfd785d1fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d1f4 expref: 18 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.761026:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.761033:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.761046:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.761052:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.761057:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.761062:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.761066:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000efb22128 already unused, calling callback (0000000040e5145c) 00010000:00010000:3.0:1789127259.761069:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.761081:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.761089:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127259.761099:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127259.761122:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009c519a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:3653:x1876035789405952:12345-0@lo:103: Request processed in 126us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127259.761128:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127259.761188:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cd3cbb22 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789405952:0@lo:103: 00000100:00100000:3.0:1789127259.761197:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000272dfbb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789406080:0@lo:103: 00010000:00010000:1.0:1789127259.761907:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c1509ad7/0xd718aadfd785d1fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d1f4 expref: 17 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127259.761918:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d22b06e7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1876035789405696:0@lo:104: 00010000:00010000:1.0:1789127259.761928:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b4ddaf5d/0xd718aadfd785d10d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d106 expref: 16 pid: 6516 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127259.761935:0:7930:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000036849b8a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7930:1876035789405824:0@lo:104: 00010000:00010000:1.0:1789127259.761950:0:7930:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127259.761966:0:7930:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127259.761971:0:7930:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127259.761975:0:7930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000efb22128/0xd718aadfd785d28e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7930 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127260.091417:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127261.112431:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127262.149043:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789127262.647713:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127262.647720:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b640b000 from 1 10000000:01000000:2.0:1789127262.647724:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127262.647798:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: 00000000b9bb1dc6/0xd718aadfd785d295 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127262.647809:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: 00000000b9bb1dc6/0xd718aadfd785d295 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127262.647818:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: 00000000b9bb1dc6/0xd718aadfd785d295 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127262.647841:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4b6354c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789406208:0@lo:101: 00000100:00100000:2.0:1789127262.647903:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127262.647952:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f28e2952 going to sleep for 11 seconds 00000100:00100000:3.0:1789127262.648017:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789406208 00000100:00100000:3.0:1789127262.648024:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789406208 00000100:00100000:3.0:1789127262.648081:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789127262.648089:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4f9c905 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789406208:12345-0@lo:101: 00010000:00010000:3.0:1789127262.648101:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127262.648111:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000000d60cc4/0xd718aadfd785d29c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d295 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127262.648131:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000000d60cc4/0xd718aadfd785d29c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d295 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127262.648141:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000000d60cc4/0xd718aadfd785d29c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d295 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127262.648163:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000000d60cc4, rc 0) 00000100:00100000:3.0:1789127262.648209:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4f9c905 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789406208:12345-0@lo:101: Request processed in 120us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127262.648216:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789127262.648358:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4b6354c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789406208:0@lo:101: 00010000:00010000:1.0:1789127262.648373:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: 00000000b9bb1dc6/0xd718aadfd785d295 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d29c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127262.648390:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: 00000000b9bb1dc6/0xd718aadfd785d295 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d29c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127262.648456:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008fa7612b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789406336:0@lo:501: 00000100:00100000:1.0:1789127262.648484:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127262.648506:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c24f0d8b going to sleep for 11 seconds 00000100:00100000:2.0:1789127262.648929:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789406336 00000100:00100000:2.0:1789127262.648934:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789406336 00000100:00100000:2.0:1789127262.648974:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789127262.649005:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097914a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789406336:12345-0@lo:501: 00000100:00100000:2.0:1789127262.649120:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097914a08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789406336:12345-0@lo:501: Request processed in 133us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127262.649128:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789127262.649159:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008fa7612b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789406336:0@lo:501: 00000100:00100000:2.0:1789127262.649187:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789406464:0@lo:503: 00000100:00100000:2.0:1789127262.649223:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127262.649248:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set 00000000472b6896 going to sleep for 11 seconds 00000100:00100000:2.0:1789127262.649259:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789406464 00000100:00100000:2.0:1789127262.649263:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789406464 00000100:00100000:2.0:1789127262.649278:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789127262.649283:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f283fa9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789406464:12345-0@lo:503: 00000100:00100000:2.0:1789127262.649354:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f283fa9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789406464:12345-0@lo:503: Request processed in 70us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127262.649361:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789127262.649404:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789406464:0@lo:503: 00000100:00100000:2.0:1789127262.649597:0:8030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8030:1876035789406592:0@lo:502: 00000100:00100000:2.0:1789127262.649627:0:8030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127262.649644:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789406592 00000100:00100000:2.0:1789127262.649647:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789406592 00000100:00100000:2.0:1789127262.649666:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789127262.649670:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008488a597 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:8030:x1876035789406592:12345-0@lo:502: 00000100:00100000:2.0:1789127262.649734:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008488a597 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:8030:x1876035789406592:12345-0@lo:502: Request processed in 63us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127262.649740:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789127262.649770:0:8030:0:(client.c:2715:ptlrpc_set_wait()) set 0000000083c1992d going to sleep for 11 seconds 00000100:00100000:2.0:1789127262.649780:0:8030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a33db54b pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8030:1876035789406592:0@lo:502: 00000020:01000000:2.0:1789127262.649798:0:8030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127262.649806:0:8030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127262.649808:0:8030:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789127262.649815:0:8030:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9346b640b000 00000020:00000080:2.0:1789127262.649818:0:8030:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789127262.649853:0:8030:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8030:1876035789406720:0@lo:502: 00000100:00100000:2.0:1789127262.649885:0:8030:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127262.649902:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789406720 00000100:00100000:2.0:1789127262.649905:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789406720 00000100:00100000:2.0:1789127262.649920:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789127262.649925:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:8030:x1876035789406720:12345-0@lo:502: 00000100:00100000:2.0:1789127262.649977:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:8030:x1876035789406720:12345-0@lo:502: Request processed in 51us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127262.649984:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789127262.650007:0:8030:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789127262.650020:0:8030:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8030:1876035789406720:0@lo:502: 00000020:01000000:2.0:1789127262.650036:0:8030:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127262.650040:0:8030:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127262.650042:0:8030:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789127262.650045:0:8030:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789127262.650089:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789127262.650105:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127262.650112:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fe600/0xd718aadfd785d295 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d29c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127262.650120:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346928fe600/0xd718aadfd785d295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d29c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127262.650135:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127262.650137:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934687bf9800 from 1 10000000:01000000:2.0:1789127262.650139:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127262.650158:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127262.650166:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127262.650174:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127262.650184:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789406848:0@lo:101: 00000100:00100000:2.0:1789127262.650208:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127262.650221:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789127262.650247:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789406848 00000100:00100000:2.0:1789127262.650250:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789406848 00000100:00100000:2.0:1789127262.650266:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789127262.650272:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789406848:12345-0@lo:101: 00010000:00010000:2.0:1789127262.650278:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127262.650288:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928fe200/0xd718aadfd785d2aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d2a3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127262.650304:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928fe200/0xd718aadfd785d2aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d2a3 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127262.650313:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928fe200/0xd718aadfd785d2aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d2a3 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127262.650329:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe200, rc 0) 00000100:00100000:2.0:1789127262.650356:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789406848:12345-0@lo:101: Request processed in 84us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127262.650363:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789127262.650390:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789406848:0@lo:101: 00010000:00010000:2.0:1789127262.650401:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d2aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127262.650409:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d2aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127262.650445:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789406976:0@lo:501: 00000100:00100000:2.0:1789127262.650469:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127262.650481:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789127262.650492:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789406976 00000100:00100000:2.0:1789127262.650495:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789406976 00000100:00100000:2.0:1789127262.650531:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789127262.650537:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789406976:12345-0@lo:501: 00000100:00100000:2.0:1789127262.650610:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789406976:12345-0@lo:501: Request processed in 73us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127262.650617:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789127262.650643:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789406976:0@lo:501: 00000100:00100000:2.0:1789127262.650665:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789407104:0@lo:503: 00000100:00100000:2.0:1789127262.650698:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127262.650710:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789127262.650724:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789407104 00000100:00100000:2.0:1789127262.650728:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789407104 00000100:00100000:2.0:1789127262.650744:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789127262.650749:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789407104:12345-0@lo:503: 00000100:00100000:2.0:1789127262.650824:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789407104:12345-0@lo:503: Request processed in 74us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127262.650831:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789127262.650864:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789407104:0@lo:503: 00000100:00100000:2.0:1789127262.660549:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8031:1876035789407232:0@lo:502: 00000100:00100000:2.0:1789127262.660638:0:8031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127262.660675:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789407232 00000100:00100000:2.0:1789127262.660682:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789407232 00000100:00100000:2.0:1789127262.660723:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789127262.660731:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:8031:x1876035789407232:12345-0@lo:502: 00000100:00100000:2.0:1789127262.660845:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:8031:x1876035789407232:12345-0@lo:502: Request processed in 115us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127262.660852:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789127262.660901:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468370a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127262.660922:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8031:1876035789407232:0@lo:502: 00000020:01000000:2.0:1789127262.660949:0:8031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127262.660958:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127262.660960:0:8031:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789127262.660968:0:8031:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff934687bf9800 00000020:00000080:2.0:1789127262.660970:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789127262.661011:0:8031:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8031:1876035789407360:0@lo:502: 00000100:00100000:2.0:1789127262.662344:0:8031:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127262.662379:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789407360 00000100:00100000:2.0:1789127262.662392:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789407360 00000100:00100000:2.0:1789127262.662427:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789127262.662435:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:8031:x1876035789407360:12345-0@lo:502: 00000100:00100000:2.0:1789127262.662536:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:8031:x1876035789407360:12345-0@lo:502: Request processed in 101us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127262.662543:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789127262.662577:0:8031:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468370a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127262.662594:0:8031:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8031:1876035789407360:0@lo:502: 00000020:01000000:2.0:1789127262.662618:0:8031:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127262.662625:0:8031:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127262.662627:0:8031:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789127262.662631:0:8031:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789127262.662682:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789127262.662699:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127262.662708:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d2aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127262.662718:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d2aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127263.163149:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127263.545183:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789407488:0@lo:41: 00000100:00100000:0.0:1789127263.545268:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127263.545722:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789407488 00000100:00100000:3.0:1789127263.545729:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789407488 00000100:00100000:3.0:1789127263.545770:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789127263.545778:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789407488:12345-0@lo:41: 00000004:00000024:3.0:1789127263.545809:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1789127263.554913:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789407488:12345-0@lo:41: Request processed in 9116us (9625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127263.554925:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789127263.555398:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789407488:0@lo:41: 00000100:00100000:2.0:1789127264.055936:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692956580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789407744:0@lo:400: 00000100:00100000:1.0:1789127264.055940:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692956d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789407616:0@lo:41: 00000100:00100000:1.0:1789127264.067595:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127264.069158:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127264.069245:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789407744 00000100:00100000:1.0:1789127264.069258:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789407744 00000100:00100000:2.0:1789127264.069279:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789407616 00000100:00100000:2.0:1789127264.069288:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789407616 00000100:00100000:2.0:1789127264.069346:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789127264.069572:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789407616:12345-0@lo:41: 00000004:00000024:2.0:1789127264.069625:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789127264.069783:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789407616:12345-0@lo:41: Request processed in 214us (2198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127264.069791:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789127264.069964:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789127264.069979:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:3652:x1876035789407744:12345-0@lo:400: 00000100:00100000:2.0:1789127264.070049:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7393840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789407872:0@lo:400: 00000100:00100000:1.0:1789127264.070094:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:3652:x1876035789407744:12345-0@lo:400: Request processed in 118us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127264.070103:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789127264.070174:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127264.070248:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692956580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789407744:0@lo:400: 00000100:00100000:2.0:1789127264.070302:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789408000:0@lo:400: 00000100:00100000:2.0:1789127264.070331:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127264.070551:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789408000 00000100:00100000:2.0:1789127264.070558:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789408000 00000100:00100000:2.0:1789127264.070591:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789127264.070599:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7391680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789408000:12345-0@lo:400: 00000100:00100000:2.0:1789127264.070644:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7391680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789408000:12345-0@lo:400: Request processed in 46us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127264.070653:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789127264.071165:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789408000:0@lo:400: 00000100:00100000:2.0:1789127264.071229:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127264.071237:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789408128:0@lo:400: 00000100:00100000:2.0:1789127264.071271:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127264.071800:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789407872 00000100:00100000:2.0:1789127264.071807:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789407872 00000100:00100000:2.0:1789127264.072045:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789408128 00000100:00100000:2.0:1789127264.072050:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789408128 00000100:00100000:2.0:1789127264.072355:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127264.072366:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7391e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789407872:12345-0@lo:400: 00000100:00100000:2.0:1789127264.072434:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7391e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789407872:12345-0@lo:400: Request processed in 70us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127264.072457:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127264.072475:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127264.072481:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7392d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789408128:12345-0@lo:400: 00000100:00100000:2.0:1789127264.072554:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7392d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789408128:12345-0@lo:400: Request processed in 71us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127264.072562:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789127264.072620:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9346b7393840 x1876035789407872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127264.072635:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7393840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789407872:0@lo:400: 00010000:00080000:2.0:1789127264.072665:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9346b73903c0 x1876035789408128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127280 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127264.072674:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789408128:0@lo:400: 00000100:00100000:2.0:1789127264.073645:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692956d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789407616:0@lo:41: 00010000:00010000:2.0:1789127264.183610:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127265.207677:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127266.234059:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127267.258820:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127268.280730:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127268.666299:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127268.666323:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789408256:0@lo:41: 00000100:00100000:3.0:1789127268.666386:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127268.675139:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789408256 00000100:00100000:2.0:1789127268.675154:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789408256 00000100:00100000:0.0:1789127268.681266:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789127268.681280:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789408256:12345-0@lo:41: 00000004:00000024:0.0:1789127268.681315:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1789127268.681393:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789408256:12345-0@lo:41: Request processed in 116us (15005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127268.681400:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789127268.690991:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789408256:0@lo:41: 00000100:00100000:2.0:1789127269.177550:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789408768:0@lo:400: 00000100:00100000:3.0:1789127269.177567:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789408384:0@lo:400: 00000100:00100000:1.0:1789127269.181643:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789408512:0@lo:400: 00000100:00100000:2.0:1789127269.184287:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127269.184380:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789408640:0@lo:400: 00000100:00100000:3.0:1789127269.184742:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127269.184776:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789408896:0@lo:400: 00000100:00100000:3.0:1789127269.184817:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127269.184853:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789408384 00000100:00100000:3.0:1789127269.184860:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789408384 00000100:00100000:0.0:1789127269.185348:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789408768 00000100:00100000:0.0:1789127269.185353:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789408768 00000100:00100000:0.0:1789127269.185704:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127269.185715:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789408768:12345-0@lo:400: 00000100:00100000:3.0:1789127269.185800:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789127269.185809:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:3653:x1876035789408384:12345-0@lo:400: 00000100:00100000:2.0:1789127269.185869:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127269.186106:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789408768:12345-0@lo:400: Request processed in 393us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127269.186114:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127269.186144:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789408896 00000100:00100000:0.0:1789127269.186166:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789408896 00000100:00100000:3.0:1789127269.186567:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:3653:x1876035789408384:12345-0@lo:400: Request processed in 758us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127269.186574:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789127269.186727:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7393480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789408384:0@lo:400: 00000100:00100000:0.0:1789127269.186809:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789408640 00000100:00100000:0.0:1789127269.186813:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789408640 00000100:00100000:0.0:1789127269.186833:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789127269.186840:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789408896:12345-0@lo:400: 00000100:00100000:0.0:1789127269.186918:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789408896:12345-0@lo:400: Request processed in 78us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127269.186925:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789127269.187288:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789408896:0@lo:400: 00000100:00100000:1.0:1789127269.190141:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127269.190249:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127269.190263:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789409024:0@lo:41: 00000100:00100000:1.0:1789127269.190307:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127269.193356:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789127269.193380:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7391a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789408640:12345-0@lo:400: 00000100:00100000:0.0:1789127269.193787:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789409024 00000100:00100000:0.0:1789127269.193798:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789409024 00000100:00100000:0.0:1789127269.193834:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127269.193842:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789409024:12345-0@lo:41: 00000100:00100000:3.0:1789127269.194171:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7391a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789408640:12345-0@lo:400: Request processed in 803us (8310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127269.194179:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000004:00000024:0.0:1789127269.194460:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789127269.194840:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789408640:0@lo:400: 00000100:00100000:0.0:1789127269.195317:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789409024:12345-0@lo:41: Request processed in 1474us (5007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127269.195327:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789127269.195373:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9346b7390b40 x1876035789408768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127269.196291:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789408768:0@lo:400: 00000100:00100000:0.0:1789127269.196337:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789408512 00000100:00100000:0.0:1789127269.196344:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789408512 00000100:00100000:3.0:1789127269.196691:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789409024:0@lo:41: 00000100:00100000:0.0:1789127269.196745:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127269.196758:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789408512:12345-0@lo:400: 00000100:00100000:0.0:1789127269.196840:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789408512:12345-0@lo:400: Request processed in 85us (6701us total) trans 0 rc 0/0 00010000:00080000:2.0:1789127269.197492:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9346b7390780 x1876035789408512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127269.197543:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789408512:0@lo:400: 00000100:00100000:0.0:1789127269.198295:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789127269.304913:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127270.329739:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127271.351680:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789127272.135691:0:8431:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789127272.135694:0:8431:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789127272.135696:0:8431:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789127272.135823:0:8431:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9346b6688800 00000020:01000004:3.0:1789127272.135839:0:8431:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789127272.135860:0:8431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789127272.136654:0:8431:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9346aec60000) 00000020:00000080:3.0:1789127272.136677:0:8431:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789127272.186590:0:8431:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1789127272.186642:0:8431:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:0.0:1789127272.230204:0:8431:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789127272.230585:0:8431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1789127272.230597:0:8431:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789127272.230608:0:8431:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd718aadfd785d2b8 00000020:01000004:0.0:1789127272.230614:0:8431:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1789127272.230635:0:8431:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789127272.230638:0:8431:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789127272.230645:0:8431:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1789127272.230649:0:8431:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1789127272.230667:0:8431:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9346aeecced8) 00000020:00000080:0.0:1789127272.230679:0:8431:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1789127272.235354:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127272.237536:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1789127272.237546:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789127272.243839:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789127272.243852:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789127272.245735:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789127272.245746:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789127272.250117:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127272.250314:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789127272.250321:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789127272.251012:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789127272.251020:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789127272.274812:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127272.275024:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789127272.275030:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789127272.278606:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789127272.278621:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789127272.281056:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789127272.281070:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789127272.288373:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127272.288582:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789127272.288588:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789127272.289959:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789127272.289968:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789127272.335307:0:8431:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127272.335489:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789127272.335496:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789127272.337651:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789127272.337663:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789127272.338004:0:8431:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789127272.338030:0:8431:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789127272.338037:0:8431:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789127272.358798:0:8431:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789127272.358835:0:8431:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.148@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1789127272.358839:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789127272.358845:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789127272.358847:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127272.358848:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127272.358849:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127272.358850:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127272.358852:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127272.358853:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789127272.358854:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789127272.358856:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127272.358857:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789127272.358861:0:8431:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1789127272.358864:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789127272.358865:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789127272.358866:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127272.358867:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127272.358868:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127272.358869:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127272.358870:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127272.358871:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789127272.358872:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789127272.358873:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127272.358874:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789127272.358909:0:8431:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789127272.358928:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789409152:0@lo:253: 00000100:00100000:1.0:1789127272.359003:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.359139:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec11540 going to sleep for 11 seconds 00000100:00100000:3.0:1789127272.359328:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789409152 00000100:00100000:3.0:1789127272.359336:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789409152 00000100:00100000:3.0:1789127272.359430:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789127272.359440:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:8431:x1876035789409152:12345-0@lo:253: 20000000:01000000:3.0:1789127272.359470:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789127272.359474:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789127272.359479:0:6517:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789127272.359482:0:6517:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1789127272.359742:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127272.359882:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1789127272.359896:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1789127272.359913:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1789127272.359918:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1789127272.359931:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1789127272.359947:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1789127272.360024:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1789127272.360038:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.148@tcp 20000000:01000000:3.0:1789127272.360041:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789127272.360056:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1789127272.360062:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789127272.360074:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1789127272.360079:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:3.0:1789127272.360091:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1789127272.360098:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789127272.360111:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1789127272.360125:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1789127272.360276:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1789127272.360288:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.148@tcp 20000000:01000000:3.0:1789127272.360290:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789127272.360304:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1789127272.360311:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789127272.360324:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1789127272.360329:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:3.0:1789127272.360353:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1789127272.360360:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789127272.360374:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1789127272.360390:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1789127272.360806:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1789127272.360819:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.148@tcp 20000000:01000000:3.0:1789127272.360820:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:3.0:1789127272.360834:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1789127272.360840:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789127272.360853:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1789127272.360859:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:3.0:1789127272.360871:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1789127272.360877:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789127272.360889:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1789127272.360904:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1789127272.360917:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789127272.360920:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789127272.360924:0:6517:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789127272.360964:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1789127272.360967:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789127272.361623:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1789127272.364443:0:8450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1789127272.364630:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1789127272.365011:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1789127272.365058:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1789127272.365076:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:1.0:1789127272.365090:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789127272.365092:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789127272.365675:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1789127272.365703:0:8451:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1789127272.365720:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789127272.365950:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789127272.365971:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789127272.365985:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789127272.365997:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789127272.365999:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789127272.366307:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1789127272.366325:0:8452:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1789127272.366357:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789127272.366636:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:1.0:1789127272.366663:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:1.0:1789127272.366676:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:1.0:1789127272.366685:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789127272.366687:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789127272.372062:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1789127272.372419:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1789127272.378303:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1789127272.378373:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1789127272.378405:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789127272.378426:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.378443:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff934680031c00/0xd718aadfd785d192 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d18b expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.378579:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346813c8000/0xd718aadfd785d209 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d202 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.378586:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928ff400/0xd718aadfd785d241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d23a expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.378593:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928fec00/0xd718aadfd785d25d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d256 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.378599:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928fe400/0xd718aadfd785d287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d280 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.378606:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.382067:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928fe400/0xd718aadfd785d287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d280 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.382084:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928fe400/0xd718aadfd785d287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d280 expref: 18 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127272.382099:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789409280:0@lo:104: 00000100:00100000:3.0:1789127272.382161:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127272.382270:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928fec00/0xd718aadfd785d25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d256 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.382292:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928fec00/0xd718aadfd785d25d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d256 expref: 18 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127272.382301:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789409408:0@lo:104: 00000100:00100000:3.0:1789127272.382321:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127272.382346:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928ff400/0xd718aadfd785d241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d23a expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.382353:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928ff400/0xd718aadfd785d241 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d23a expref: 18 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127272.382361:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789409536:0@lo:104: 00000100:00100000:3.0:1789127272.382378:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127272.382391:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346813c8000/0xd718aadfd785d209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d202 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.382399:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346813c8000/0xd718aadfd785d209 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d202 expref: 18 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127272.382406:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692921a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789409664:0@lo:104: 00000100:00100000:3.0:1789127272.382421:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127272.382434:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff934680031c00/0xd718aadfd785d192 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d18b expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.382441:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff934680031c00/0xd718aadfd785d192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d18b expref: 18 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.382652:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127272.382748:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692921e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789409792:0@lo:104: 00000100:00100000:3.0:1789127272.382779:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127272.382797:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a06aeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127272.382815:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789409280 00000100:00100000:3.0:1789127272.382821:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789409280 00000100:00100000:3.0:1789127272.382855:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789409408 00000100:00100000:0.0:1789127272.383027:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789409536 00000100:00100000:0.0:1789127272.383032:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789409536 00000100:00100000:0.0:1789127272.383049:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789409664 00000100:00100000:0.0:1789127272.383052:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789409664 00000100:00100000:0.0:1789127272.383059:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789409792 00000100:00100000:0.0:1789127272.383061:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789409792 00000100:00100000:0.0:1789127272.383073:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127272.383080:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:6517:x1876035789409280:12345-0@lo:104: 00010000:00010000:0.0:1789127272.383093:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d287 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.383146:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127272.383152:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:6517:x1876035789409280:12345-0@lo:104: Request processed in 72us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127272.383159:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127272.383256:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127272.383262:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692923480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:6517:x1876035789409536:12345-0@lo:104: 00010000:00010000:0.0:1789127272.383270:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d23a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d241 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.383300:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789127272.383305:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692923480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:6517:x1876035789409536:12345-0@lo:104: Request processed in 44us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127272.383310:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127272.383320:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127272.383325:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:6517:x1876035789409664:12345-0@lo:104: 00010000:00010000:0.0:1789127272.383331:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d209 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.383354:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789127272.383357:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929221c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:6517:x1876035789409664:12345-0@lo:104: Request processed in 33us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127272.383362:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127272.383371:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127272.383376:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692922580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6517:x1876035789409792:12345-0@lo:104: 00010000:00010000:0.0:1789127272.383381:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff934680030e00/0xd718aadfd785d18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d192 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.383400:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789127272.383404:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692922580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6517:x1876035789409792:12345-0@lo:104: Request processed in 28us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127272.383409:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1789127272.383421:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789127272.383432:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d287 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.383438:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1c00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127272.383442:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d287 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127272.383542:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789409408 00000100:00100000:3.0:1789127272.383569:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127272.383575:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72abc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6517:x1876035789409408:12345-0@lo:104: 00010000:00010000:3.0:1789127272.383582:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d25d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.383693:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d287 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127272.383702:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d287 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127272.383707:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127272.383734:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d287 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.383739:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127272.383756:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d280 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d287 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.383762:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d287 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.383777:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789127272.383780:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d23a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d241 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.383786:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff000 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127272.383789:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d23a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d241 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.383805:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d23a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d241 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127272.383812:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d23a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d241 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127272.383817:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127272.383831:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d23a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d241 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.383837:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127272.383850:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d23a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d241 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.383967:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1789127272.383990:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127272.384005:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789409920:0@lo:103: 00000100:00100000:2.0:1789127272.384040:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127272.384072:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127272.384081:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789410048:0@lo:103: 00000100:00100000:2.0:1789127272.384101:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127272.384126:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789409920 00000100:00100000:2.0:1789127272.384130:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789409920 00010000:00010000:2.0:1789127272.384149:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928fe400/0xd718aadfd785d287 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d280 expref: 19 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127272.384168:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789410048 00010000:00010000:3.0:1789127272.384255:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789127272.384261:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72abc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6517:x1876035789409408:12345-0@lo:104: Request processed in 687us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127272.384269:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1789127272.384312:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d23a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d241 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.384326:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127272.384329:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff934680030e00/0xd718aadfd785d18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d192 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.384335:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934680030e00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127272.384338:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff934680030e00/0xd718aadfd785d18b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d192 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.384345:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934680030e00/0xd718aadfd785d18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d192 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127272.384351:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934680030e00/0xd718aadfd785d18b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d192 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127272.384363:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127272.384394:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff934680030e00/0xd718aadfd785d18b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d192 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.384401:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127272.384410:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff934680030e00/0xd718aadfd785d18b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d192 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.384418:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934680030e00/0xd718aadfd785d18b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d192 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.384428:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127272.384431:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d25d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.384436:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fea00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127272.384439:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d25d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.384446:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d25d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127272.388386:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d25d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127272.388394:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127272.388440:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d25d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.388446:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127272.388565:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d256 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d25d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.388572:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d25d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.388590:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127272.388592:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127272.388594:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127272.388609:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127272.388630:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789410304:0@lo:103: 00000100:00100000:0.0:1789127272.388692:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127272.388726:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127272.388736:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789410176:0@lo:103: 00000100:00100000:0.0:1789127272.388760:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127272.388851:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789410048 00010000:00010000:2.0:1789127272.388888:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928ff400/0xd718aadfd785d241 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d23a expref: 20 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127272.388910:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789410304 00000100:00100000:2.0:1789127272.388913:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789410304 00010000:00010000:2.0:1789127272.388924:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928fec00/0xd718aadfd785d25d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d256 expref: 21 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127272.388947:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789410176 00000100:00100000:2.0:1789127272.388951:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789410176 00010000:00010000:2.0:1789127272.388962:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff934680031c00/0xd718aadfd785d192 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d18b expref: 22 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127272.388976:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789127272.388984:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7392580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:3650:x1876035789409920:12345-0@lo:103: 00010000:00010000:2.0:1789127272.388995:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127272.389000:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928fe400/0xd718aadfd785d287 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d280 expref: 22 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.389011:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928fe400/0xd718aadfd785d287 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d280 expref: 22 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.389028:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127272.389059:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7392580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:3650:x1876035789409920:12345-0@lo:103: Request processed in 76us (5019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127272.389066:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789127272.389082:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127272.389088:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7393480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3653:x1876035789410048:12345-0@lo:103: 00010000:00010000:2.0:1789127272.389094:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127272.389099:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928ff400/0xd718aadfd785d241 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d23a expref: 21 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.389107:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928ff400/0xd718aadfd785d241 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d23a expref: 21 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.389115:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127272.389143:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7393480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3653:x1876035789410048:12345-0@lo:103: Request processed in 56us (5041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127272.389150:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127272.389163:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127272.389285:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:3651:x1876035789410304:12345-0@lo:103: 00010000:00010000:2.0:1789127272.389293:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127272.389298:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928fec00/0xd718aadfd785d25d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d256 expref: 20 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.389306:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928fec00/0xd718aadfd785d25d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d256 expref: 20 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.389316:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127272.389348:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:3651:x1876035789410304:12345-0@lo:103: Request processed in 178us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127272.389354:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127272.389367:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127272.389372:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346a5388f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:3652:x1876035789410176:12345-0@lo:103: 00010000:00010000:2.0:1789127272.389380:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127272.389383:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff934680031c00/0xd718aadfd785d192 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d18b expref: 19 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.389391:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff934680031c00/0xd718aadfd785d192 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d18b expref: 19 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.389400:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127272.389428:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346a5388f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:3652:x1876035789410176:12345-0@lo:103: Request processed in 56us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127272.389434:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127272.389570:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789410048:0@lo:103: 00000100:00100000:2.0:1789127272.389602:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789409920:0@lo:103: 00000100:00100000:2.0:1789127272.389963:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789410176:0@lo:103: 00000100:00100000:2.0:1789127272.389990:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789410304:0@lo:103: 00010000:00010000:2.0:1789127272.390152:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928fe400/0xd718aadfd785d287 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d280 expref: 18 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127272.390164:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789409280:0@lo:104: 00010000:00010000:2.0:1789127272.390191:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928fec00/0xd718aadfd785d25d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d256 expref: 17 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127272.390199:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789409408:0@lo:104: 00010000:00010000:2.0:1789127272.390209:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928ff400/0xd718aadfd785d241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d23a expref: 16 pid: 6517 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127272.390216:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789409536:0@lo:104: 00000100:00100000:2.0:1789127272.390224:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692921a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789409664:0@lo:104: 00010000:00010000:2.0:1789127272.390233:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934680031c00/0xd718aadfd785d192 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d18b expref: 15 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127272.390242:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692921e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789409792:0@lo:104: 00010000:00010000:2.0:1789127272.390265:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.393732:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127272.393738:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127272.393752:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127272.393783:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d209 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.393795:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0400 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127272.393800:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d209 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.393809:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d209 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127272.394120:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d209 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127272.394127:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127272.394298:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d209 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.394310:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789127272.394366:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586045e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789410432:0@lo:103: 00000100:00100000:2.0:1789127272.394435:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.394543:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789410432 00000100:00100000:1.0:1789127272.394551:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789410432 00010000:00010000:1.0:1789127272.394582:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346813c8000/0xd718aadfd785d209 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d202 expref: 15 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127272.394612:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789127272.394620:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9dec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:3651:x1876035789410432:12345-0@lo:103: 00010000:00010000:1.0:1789127272.394633:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127272.394637:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346813c8000/0xd718aadfd785d209 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d202 expref: 15 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.394647:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346813c8000/0xd718aadfd785d209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d202 expref: 15 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.394662:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346813c8000/0xd718aadfd785d209 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d202 expref: 15 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.394677:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.394686:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.394699:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.394706:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.394719:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.394724:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.394730:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127272.394733:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.394741:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.394756:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.394766:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127272.396040:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d202 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d209 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.396059:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d202 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d209 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.396079:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127272.396082:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127272.396084:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127272.398966:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9dec450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:3651:x1876035789410432:12345-0@lo:103: Request processed in 4338us (4521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127272.398981:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789127272.399057:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.399067:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.399073:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93469a7a1600/0xd718aadfd785d2c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789127272.399090:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789127272.399284:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586045e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789410432:0@lo:103: 00000100:00100000:1.0:1789127272.403158:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:8431:x1876035789409152:12345-0@lo:253: Request processed in 43712us (44146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127272.403190:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789127272.405680:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a30c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789409152:0@lo:253: 10000000:01000000:2.0:1789127272.405700:0:8431:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789127272.405704:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789127272.405706:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789127272.405707:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127272.405708:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789127272.405710:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127272.405711:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127272.405712:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127272.405714:0:8431:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789127272.405716:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127272.405717:0:8431:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789127272.407047:0:8431:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9346b6688800 from lustre-OST0000 10000000:01000000:3.0:1789127272.407087:0:8431:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789127272.407090:0:8431:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789127272.407100:0:8431:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9346b18f3490 local copy 10000000:01000000:3.0:1789127272.407103:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789127272.407141:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.407153:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.407164:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127272.407356:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789410560:0@lo:101: 00000100:00100000:3.0:1789127272.407419:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127272.407544:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a06aed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127272.407930:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789410560 00000100:00100000:0.0:1789127272.407938:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789410560 00000100:00100000:1.0:1789127272.408089:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789127272.408100:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+13:8431:x1876035789410560:12345-0@lo:101: 00010000:00010000:1.0:1789127272.408113:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127272.408126:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346c214da00/0xd718aadfd785d2d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d2cd expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.408150:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346c214da00/0xd718aadfd785d2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d2cd expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.408160:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346c214da00/0xd718aadfd785d2d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d2cd expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.408186:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214da00, rc 0) 00000100:00100000:1.0:1789127272.408237:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:8431:x1876035789410560:12345-0@lo:101: Request processed in 140us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127272.408244:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789127272.408323:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789410560:0@lo:101: 00010000:00010000:3.0:1789127272.408337:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd718aadfd785d2d4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.408346:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd718aadfd785d2d4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127272.408435:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789410688:0@lo:501: 00000100:00100000:3.0:1789127272.408473:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127272.408787:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a06aed80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127272.408856:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789410688 00000100:00100000:0.0:1789127272.408869:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789410688 00000100:00100000:0.0:1789127272.408896:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789127272.408903:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:8431:x1876035789410688:12345-0@lo:501: 00000100:00100000:0.0:1789127272.408974:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:8431:x1876035789410688:12345-0@lo:501: Request processed in 72us (500us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127272.408981:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789127272.409098:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789410688:0@lo:501: 10000000:01000000:3.0:1789127272.409110:0:8431:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789127272.409127:0:8431:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789127272.409132:0:8431:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd718aadfd785d2d4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.409141:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd718aadfd785d2d4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.409148:0:8431:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd718aadfd785d2d4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.409181:0:8431:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789127272.409216:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9346b6688800 10000000:01000000:3.0:1789127272.409220:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789127272.409225:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789127272.409227:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789127272.409231:0:8431:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789127272.409233:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789127272.409250:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.409257:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.409265:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127272.409278:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789410816:0@lo:101: 00000100:00100000:3.0:1789127272.409306:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127272.409319:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a06ae0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127272.409425:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789410816 00000100:00100000:0.0:1789127272.409429:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789410816 00000100:00100000:0.0:1789127272.409541:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789127272.409550:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:8431:x1876035789410816:12345-0@lo:101: 00010000:00010000:0.0:1789127272.409557:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127272.409567:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346813c8400/0xd718aadfd785d2e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d2db expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.409583:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346813c8400/0xd718aadfd785d2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d2db expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.409600:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346813c8400/0xd718aadfd785d2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d2db expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.409608:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346813c8400, rc 0) 00000100:00100000:0.0:1789127272.409648:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8431:x1876035789410816:12345-0@lo:101: Request processed in 100us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127272.409655:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:0.0:1789127272.409679:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127272.409685:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd718aadfd785d2d4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.409692:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0800 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127272.409696:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd718aadfd785d2d4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.409704:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd718aadfd785d2d4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127272.409712:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd718aadfd785d2d4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127272.409718:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127272.409736:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd718aadfd785d2d4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.409742:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127272.409758:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd718aadfd785d2d4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.409775:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d2cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd718aadfd785d2d4 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.409786:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127272.409788:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127272.409789:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127272.409796:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789127272.409806:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345860443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789410944:0@lo:103: 00000100:00100000:0.0:1789127272.409832:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127272.409962:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789410816:0@lo:101: 00010000:00010000:3.0:1789127272.409973:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d2e2 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.409981:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d2e2 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127272.410043:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411072:0@lo:501: 00000100:00100000:3.0:1789127272.410070:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127272.410104:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789410944 00000100:00100000:0.0:1789127272.410109:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789410944 00000100:00100000:1.0:1789127272.410235:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789411072 00000100:00100000:1.0:1789127272.410239:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789411072 00000100:00100000:1.0:1789127272.410260:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789127272.410267:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:8431:x1876035789411072:12345-0@lo:501: 00000100:00100000:1.0:1789127272.410346:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:8431:x1876035789411072:12345-0@lo:501: Request processed in 79us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127272.410353:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789127272.410380:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127272.410388:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586045680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:3653:x1876035789410944:12345-0@lo:103: 00010000:00010000:1.0:1789127272.410405:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127272.410417:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346c214da00/0xd718aadfd785d2d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d2cd expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.410427:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127272.410469:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586045680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:3653:x1876035789410944:12345-0@lo:103: Request processed in 82us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127272.410476:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127272.410710:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a06ae0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127272.410727:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411072:0@lo:501: 00000100:00100000:3.0:1789127272.410776:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411200:0@lo:503: 00000100:00100000:3.0:1789127272.410815:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127272.410841:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a06ae0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127272.410975:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789411200 00000100:00100000:2.0:1789127272.410980:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789411200 00000100:00100000:2.0:1789127272.411012:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789127272.411019:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:8431:x1876035789411200:12345-0@lo:503: 00000100:00100000:2.0:1789127272.411099:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:8431:x1876035789411200:12345-0@lo:503: Request processed in 80us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127272.411106:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789127272.411208:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411200:0@lo:503: 00000040:00080000:3.0:1789127272.411444:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127272.411671:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411328:0@lo:502: 00000100:00100000:3.0:1789127272.411707:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127272.411726:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a06ae0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127272.411784:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789411328 00000100:00100000:2.0:1789127272.411789:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789411328 00000100:00100000:2.0:1789127272.411821:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789127272.411828:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:8431:x1876035789411328:12345-0@lo:502: 00000100:00100000:2.0:1789127272.411913:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:8431:x1876035789411328:12345-0@lo:502: Request processed in 85us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127272.411920:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789127272.412058:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411328:0@lo:502: 00000040:00080000:3.0:1789127272.412327:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789127272.412354:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789127272.412369:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789127272.412382:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789127272.412396:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789127272.412411:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789127272.412432:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411456:0@lo:502: 00000100:00100000:3.0:1789127272.412562:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127272.412582:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a06ae0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127272.412645:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789411456 00000100:00100000:2.0:1789127272.412655:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789411456 00000100:00100000:2.0:1789127272.412688:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789127272.412695:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:8431:x1876035789411456:12345-0@lo:502: 00000100:00100000:2.0:1789127272.412768:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:8431:x1876035789411456:12345-0@lo:502: Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127272.412774:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789127272.412814:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411456:0@lo:502: 00000040:00080000:2.0:1789127272.412878:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789127272.412886:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:1.0:1789127272.415344:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345860443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789410944:0@lo:103: 00000020:01000000:0.0:1789127272.417798:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789127272.417809:0:8455:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789127272.417816:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127272.417818:0:8455:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789127272.417824:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127272.417840:0:8455:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9346aeecb490) 00000020:00000080:0.0:1789127272.417870:0:8455:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789127272.417877:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789127272.417972:0:8455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9346b6688800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789127272.417980:0:8455:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789127272.417987:0:8455:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd718aadfd785d2f0 00010000:00010000:1.0:1789127272.426004:0:8455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1789127272.426429:0:8455:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789127272.433559:0:8455:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789127272.434092:0:8455:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1789127272.452011:0:8455:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789127272.452207:0:8455:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1789127272.474494:0:8455:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789127272.481002:0:8455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789127272.481015:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127272.481021:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127272.481023:0:8455:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789127272.481026:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127272.481030:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127272.481031:0:8455:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789127272.481034:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789127272.481036:0:8455:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789127272.481049:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127272.481052:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127272.481053:0:8455:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789127272.481056:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789127272.481252:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1789127272.481280:0:8431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789127272.481302:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d2e2 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.481314:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d2e2 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127272.481321:0:8431:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b6688800 from 1 10000000:01000000:3.0:1789127272.481330:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127272.481378:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.481386:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.481396:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127272.481418:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411584:0@lo:101: 00000100:00100000:3.0:1789127272.481485:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127272.481557:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a06ae540 going to sleep for 11 seconds 00000100:00100000:1.0:1789127272.481588:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789411584 00000100:00100000:1.0:1789127272.481596:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789411584 00000100:00100000:1.0:1789127272.481642:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789127272.481651:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:8431:x1876035789411584:12345-0@lo:101: 00010000:00010000:1.0:1789127272.481664:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127272.481677:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346c214da00/0xd718aadfd785d2fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d2f7 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.481699:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346c214da00/0xd718aadfd785d2fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d2f7 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.481709:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346c214da00/0xd718aadfd785d2fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d2f7 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.481718:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214da00, rc 0) 00000100:00100000:1.0:1789127272.481764:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8431:x1876035789411584:12345-0@lo:101: Request processed in 114us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127272.481771:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789127272.481815:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411584:0@lo:101: 00010000:00010000:1.0:1789127272.481828:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d2fe expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.481837:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d2fe expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127272.482030:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411712:0@lo:501: 00000100:00100000:1.0:1789127272.482056:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.482078:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127272.486314:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789411712 00000100:00100000:3.0:1789127272.486328:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789411712 00000100:00100000:3.0:1789127272.486376:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789127272.486386:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8431:x1876035789411712:12345-0@lo:501: 00000100:00100000:3.0:1789127272.486934:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8431:x1876035789411712:12345-0@lo:501: Request processed in 547us (4874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127272.486944:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789127272.486948:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411712:0@lo:501: 00000100:00100000:1.0:1789127272.486999:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411840:0@lo:503: 00000100:00100000:1.0:1789127272.487050:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.487084:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127272.488214:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789411840 00000100:00100000:3.0:1789127272.488223:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789411840 00000100:00100000:3.0:1789127272.488273:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789127272.488282:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8431:x1876035789411840:12345-0@lo:503: 00000100:00100000:3.0:1789127272.488410:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8431:x1876035789411840:12345-0@lo:503: Request processed in 129us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127272.488418:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789127272.491382:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411840:0@lo:503: 00000040:00080000:2.0:1789127272.491699:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127272.491801:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411968:0@lo:502: 00000100:00100000:2.0:1789127272.492208:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127272.492253:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346c1e99cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127272.494643:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789411968 00000100:00100000:3.0:1789127272.494653:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789411968 00000100:00100000:0.0:1789127272.494786:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789127272.494799:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8431:x1876035789411968:12345-0@lo:502: 00000100:00100000:0.0:1789127272.494990:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8431:x1876035789411968:12345-0@lo:502: Request processed in 194us (2783us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127272.495005:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789127272.497548:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73921c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789411968:0@lo:502: 00000040:00080000:1.0:1789127272.497793:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1789127272.497826:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1789127272.497871:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789412096:0@lo:502: 00000100:00100000:1.0:1789127272.497936:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.497981:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127272.498334:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789412096 00000100:00100000:2.0:1789127272.498340:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789412096 00000100:00100000:2.0:1789127272.498402:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789127272.498412:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8431:x1876035789412096:12345-0@lo:502: 00000100:00100000:2.0:1789127272.498553:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8431:x1876035789412096:12345-0@lo:502: Request processed in 142us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127272.498561:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789127272.498648:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789412096:0@lo:502: 00000040:00080000:1.0:1789127272.498696:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1789127272.498704:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789127272.500023:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127272.500035:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127272.500037:0:8459:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789127272.500044:0:8459:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9346b6688800 00000020:00000080:3.0:1789127272.500046:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127272.500058:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127272.500061:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127272.500063:0:8459:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789127272.500066:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1789127272.500259:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789127272.500284:0:8431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127272.500305:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d2fe expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.500317:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d2fe expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127272.500361:0:8431:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789127272.500364:0:8431:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9346b6688800 10000000:01000000:1.0:1789127272.500367:0:8431:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9346b6688800 10000000:01000000:1.0:1789127272.500370:0:8431:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789127272.500375:0:8431:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9346b6688800 from 1 10000000:01000000:1.0:1789127272.500378:0:8431:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789127272.500407:0:8431:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.500415:0:8431:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.500425:0:8431:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127272.500444:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789412224:0@lo:101: 00000100:00100000:1.0:1789127272.500498:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.501279:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127272.502447:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789412224 00000100:00100000:3.0:1789127272.502457:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789412224 00000100:00100000:3.0:1789127272.502528:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789127272.502539:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8431:x1876035789412224:12345-0@lo:101: 00010000:00010000:3.0:1789127272.502553:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127272.502570:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d30c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d305 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.502595:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d30c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d305 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.502606:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d30c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d305 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127272.502614:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a0200, rc 0) 00000100:00100000:3.0:1789127272.502669:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:8431:x1876035789412224:12345-0@lo:101: Request processed in 132us (2170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127272.502676:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789127272.504717:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789412224:0@lo:101: 00010000:00010000:1.0:1789127272.504745:0:8431:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d30c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.504778:0:8431:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d30c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127272.504903:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789412352:0@lo:501: 00000100:00100000:1.0:1789127272.504959:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.505002:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b66c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127272.505067:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789412352 00000100:00100000:0.0:1789127272.505073:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789412352 00000100:00100000:0.0:1789127272.505115:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789127272.505123:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:8431:x1876035789412352:12345-0@lo:501: 00000100:00100000:0.0:1789127272.505256:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:8431:x1876035789412352:12345-0@lo:501: Request processed in 132us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127272.505264:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789127272.506065:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789412352:0@lo:501: 00000100:00100000:1.0:1789127272.506099:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789412480:0@lo:503: 00000100:00100000:1.0:1789127272.506144:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.506190:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127272.507052:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789412480 00000100:00100000:2.0:1789127272.507060:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789412480 00000100:00100000:2.0:1789127272.507112:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789127272.507137:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:8431:x1876035789412480:12345-0@lo:503: 00000100:00100000:2.0:1789127272.507986:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:8431:x1876035789412480:12345-0@lo:503: Request processed in 859us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127272.507995:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789127272.510725:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789412480:0@lo:503: 00000040:00080000:1.0:1789127272.510978:0:8431:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127272.511073:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789412608:0@lo:502: 00000100:00100000:1.0:1789127272.511138:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.511235:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127272.515743:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789412608 00000100:00100000:3.0:1789127272.515757:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789412608 00000100:00100000:3.0:1789127272.515819:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789127272.515829:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:8431:x1876035789412608:12345-0@lo:502: 00000100:00100000:3.0:1789127272.516011:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:8431:x1876035789412608:12345-0@lo:502: Request processed in 183us (4873us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127272.516019:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789127272.516202:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789412608:0@lo:502: 00000040:00080000:2.0:1789127272.516467:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789127272.516495:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789127272.516584:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789127272.516603:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789127272.516616:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789127272.516628:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789127272.516640:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789127272.516652:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789127272.516664:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789127272.516675:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789127272.516687:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789127272.516699:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789127272.516710:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789127272.516721:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789127272.516732:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789127272.516744:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789127272.516764:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789127272.516776:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789127272.516789:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789127272.516803:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789127272.516816:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789127272.516829:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789127272.516843:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789127272.516858:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789127272.516872:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789127272.516886:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789127272.516898:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789127272.516910:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789127272.516921:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789127272.516934:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789127272.516948:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789127272.516977:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789127272.516992:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789127272.517004:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789127272.517018:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789127272.517029:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789127272.517040:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:2.0:1789127272.517076:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73912c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789412736:0@lo:502: 00000100:00100000:2.0:1789127272.517126:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127272.517163:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346c1e99480 going to sleep for 11 seconds 00000100:00100000:3.0:1789127272.517613:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789412736 00000100:00100000:3.0:1789127272.517620:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789412736 00000100:00100000:3.0:1789127272.517657:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789127272.517665:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:8431:x1876035789412736:12345-0@lo:502: 00000100:00100000:3.0:1789127272.517771:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:8431:x1876035789412736:12345-0@lo:502: Request processed in 107us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127272.517779:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789127272.517859:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73912c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789412736:0@lo:502: 00000040:00080000:0.0:1789127272.517911:0:8431:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1789127272.517921:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1789127272.525915:0:8460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789127272.525933:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9346aec61a48) 00000020:00000080:3.0:1789127272.525954:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789127272.526058:0:8460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9346b6688800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789127272.526062:0:8460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9346b6688800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789127272.526065:0:8460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9346b6688800 3 00010000:00080000:3.0:1789127272.526098:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9345862ed800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1789127272.527790:0:8460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1789127272.528382:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789127272.528426:0:8460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789127272.528437:0:8460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd718aadfd785d31a 00000100:00080000:3.0:1789127272.528447:0:8460:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127272.528453:0:8460:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9345862ed800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789127272.528488:0:8460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934692921e00 x1876035789412864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127272.528563:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692921e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1876035789412864:0@lo:38: 00000100:00100000:2.0:1789127272.528626:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.528713:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789412864 00000100:00100000:1.0:1789127272.528720:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789412864 00000100:00100000:1.0:1789127272.528752:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789127272.528760:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7392940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1876035789412864:12345-0@lo:38: 00010000:00080000:1.0:1789127272.528782:0:6524:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1789127272.528811:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd718aadfd785d321 00000004:00100000:1.0:1789127272.528826:0:6524:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789127272.528855:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9346b7255800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1789127272.528944:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000020:01000004:0.0:1789127272.530861:0:8460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789127272.530877:0:8460:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9346aeec8000) 00000020:00000080:0.0:1789127272.530898:0:8460:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1789127272.530986:0:8460:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9346b6688800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789127272.530990:0:8460:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9346b6688800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789127272.530992:0:8460:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9346b6688800 3 00010000:00080000:0.0:1789127272.531018:0:8460:0:(ldlm_lib.c:102:import_set_conn()) imp ffff934586070000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.148@tcp at head 00000100:00100000:1.0:1789127272.535825:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7392940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876035789412864:12345-0@lo:38: Request processed in 7055us (7189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127272.535846:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789127272.535983:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789412992:0@lo:400: 00000100:00100000:1.0:1789127272.536047:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.536079:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127272.536085:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789413376:0@lo:400: 00000100:00100000:1.0:1789127272.536108:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.536137:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789413120:0@lo:400: 00000100:00100000:1.0:1789127272.536157:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.536185:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127272.536190:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789413248:0@lo:400: 00000100:00100000:1.0:1789127272.536209:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.536235:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789412992 00000100:00100000:1.0:1789127272.536242:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789412992 00000100:00100000:1.0:1789127272.536271:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789413248 00000100:00100000:1.0:1789127272.536273:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789413248 00000100:00100000:1.0:1789127272.536302:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789127272.536309:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789412992:12345-0@lo:400: 00000100:00100000:1.0:1789127272.536353:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789412992:12345-0@lo:400: Request processed in 44us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127272.536358:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789127272.536369:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789127272.536374:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789413248:12345-0@lo:400: 00000100:00100000:1.0:1789127272.536399:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789413248:12345-0@lo:400: Request processed in 25us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127272.536405:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789127272.536421:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789413376 00000100:00100000:1.0:1789127272.536429:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789413376 00000100:00100000:1.0:1789127272.536451:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789413120 00000100:00100000:1.0:1789127272.536454:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789413120 00000100:00100000:1.0:1789127272.536467:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789127272.536472:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789413376:12345-0@lo:400: 00000100:00100000:1.0:1789127272.536503:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789413376:12345-0@lo:400: Request processed in 31us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127272.536530:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789127272.536542:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789127272.536548:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789413120:12345-0@lo:400: 00000100:00100000:1.0:1789127272.536575:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789413120:12345-0@lo:400: Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127272.536580:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1789127272.536625:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9346b73a1a40 x1876035789413248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127272.536640:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789413248:0@lo:400: 00000100:00100000:1.0:1789127272.536652:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789413120:0@lo:400: 00000100:00100000:1.0:1789127272.536677:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789413376:0@lo:400: 00010000:00080000:1.0:1789127272.536686:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9346b73a12c0 x1876035789412992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127272.536695:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789412992:0@lo:400: 00010000:00080000:2.0:1789127272.536987:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff934692921e00 x1876035789412864/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127272.536996:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127272.537004:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789127272.537019:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789127272.537024:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789127272.537027:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9345862ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789127272.537034:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692921e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1876035789412864:0@lo:38: 00010000:00010000:1.0:1789127272.539117:0:8460:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1789127272.539364:0:8460:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789127272.539410:0:8460:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789127272.547368:0:8460:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd718aadfd785d32f 00000100:00080000:1.0:1789127272.547386:0:8460:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789127272.547400:0:8460:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff934586070000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789127272.547438:0:8460:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9346b73a12c0 x1876035789413504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127272.547555:0:8460:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789127272.547831:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3649:1876035789413504:0@lo:38: 00000100:00100000:2.0:1789127272.547907:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.548635:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789413504 00000100:00100000:1.0:1789127272.548643:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789413504 00000100:00100000:1.0:1789127272.548690:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127272.548697:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7393c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1876035789413504:12345-0@lo:38: 00010000:00080000:1.0:1789127272.548724:0:6523:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1789127272.548757:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd718aadfd785d336 00000004:00100000:1.0:1789127272.548772:0:6523:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789127272.548804:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9346aecb9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127272.549026:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7393c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876035789413504:12345-0@lo:38: Request processed in 328us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127272.549034:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1789127272.549143:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00010000:00080000:2.0:1789127272.549473:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9346b73a12c0 x1876035789413504/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127272.549485:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127272.549492:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789127272.549499:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789127272.549503:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789127272.549505:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934586070000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789127272.549527:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3649:1876035789413504:0@lo:38: 00000020:01000000:0.0:1789127272.557143:0:8431:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1789127272.557196:0:8431:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789127272.557225:0:8431:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d30c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127272.557237:0:8431:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d30c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789127272.557297:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789127272.557299:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789127272.557304:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127272.557305:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127272.557306:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127272.557308:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127272.557309:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789127272.557310:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789127272.557311:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789127272.557313:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127272.557314:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789127272.557317:0:8431:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1789127272.557319:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789127272.557320:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789127272.557321:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127272.557322:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127272.557323:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127272.557324:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127272.557325:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789127272.557326:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789127272.557326:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789127272.557327:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127272.557328:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789127272.557362:0:8431:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789127272.557383:0:8431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586046d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789413632:0@lo:253: 00000100:00100000:0.0:1789127272.558067:0:8431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127272.558117:0:8431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ac900 going to sleep for 11 seconds 00000100:00100000:2.0:1789127272.558186:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789413632 00000100:00100000:2.0:1789127272.558194:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789413632 00000100:00100000:2.0:1789127272.558256:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789127272.558266:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:8431:x1876035789413632:12345-0@lo:253: 20000000:01000000:2.0:1789127272.558293:0:6516:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789127272.558307:0:6516:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789127272.566075:0:6516:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789127272.566097:0:6516:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789127272.566237:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789127272.566243:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789127272.566590:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.566621:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346c214d800/0xd718aadfd785d233 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d22c expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.566630:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928ff600/0xd718aadfd785d24f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d248 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.566638:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.566695:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928ff600/0xd718aadfd785d24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d248 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.566721:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928ff600/0xd718aadfd785d24f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d248 expref: 16 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127272.566737:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a30c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1876035789413760:0@lo:104: 00000100:00100000:1.0:1789127272.566803:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127272.567006:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346c214d800/0xd718aadfd785d233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d22c expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.567015:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346c214d800/0xd718aadfd785d233 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d22c expref: 16 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127272.567023:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1876035789413888:0@lo:104: 00000100:00100000:1.0:1789127272.567045:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6180 going to sleep for 11 seconds 00000100:00100000:2.0:1789127272.567311:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789127272.567330:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127272.567357:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789413760 00000100:00100000:2.0:1789127272.567363:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789413760 00000100:00100000:2.0:1789127272.567391:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789413888 00000100:00100000:2.0:1789127272.567400:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789413888 00000100:00100000:2.0:1789127272.567413:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127272.567421:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:6538:x1876035789413760:12345-0@lo:104: 00010000:00010000:2.0:1789127272.567433:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346928ff200/0xd718aadfd785d248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d24f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.567484:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789127272.567489:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72fc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:6538:x1876035789413760:12345-0@lo:104: Request processed in 70us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127272.567496:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127272.567554:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127272.567560:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6538:x1876035789413888:12345-0@lo:104: 00010000:00010000:2.0:1789127272.567568:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d22c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d233 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.567598:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789127272.567603:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73912c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6538:x1876035789413888:12345-0@lo:104: Request processed in 45us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127272.567609:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789127272.567625:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127272.567631:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928ff200/0xd718aadfd785d248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d24f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.567638:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff200 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127272.567642:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928ff200/0xd718aadfd785d248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d24f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.567649:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928ff200/0xd718aadfd785d248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d24f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127272.567667:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928ff200/0xd718aadfd785d248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d24f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127272.567673:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1789127272.568013:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:8431:x1876035789413632:12345-0@lo:253: Request processed in 9749us (9948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127272.568022:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789127272.568066:0:8431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586046d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:8431:1876035789413632:0@lo:253: 10000000:01000000:0.0:1789127272.568077:0:8431:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789127272.568081:0:8431:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789127272.568083:0:8431:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789127272.568084:0:8431:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127272.568086:0:8431:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127272.568087:0:8431:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127272.568088:0:8431:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127272.568090:0:8431:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789127272.568096:0:8431:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789127272.568097:0:8431:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789127272.568099:0:8431:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127272.568100:0:8431:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789127272.568114:0:8431:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1789127272.569063:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346928ff200/0xd718aadfd785d248 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d24f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.569075:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127272.569105:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928ff200/0xd718aadfd785d248 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d24f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.569112:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928ff200/0xd718aadfd785d248 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d24f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.569129:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127272.569133:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d22c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d233 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.569139:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214ce00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127272.569142:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d22c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d233 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.569149:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d233 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127272.569157:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d22c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d233 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127272.569162:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1789127272.569325:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789414016:0@lo:103: 00000100:00100000:1.0:1789127272.569382:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127272.569431:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789414016 00000100:00100000:1.0:1789127272.569437:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789414016 00010000:00010000:1.0:1789127272.569477:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928ff600/0xd718aadfd785d24f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d248 expref: 16 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127272.569505:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789127272.569531:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:3653:x1876035789414016:12345-0@lo:103: 00010000:00010000:1.0:1789127272.569542:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127272.569547:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928ff600/0xd718aadfd785d24f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d248 expref: 16 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.569568:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928ff600/0xd718aadfd785d24f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d248 expref: 16 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127272.569586:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127272.569617:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:3653:x1876035789414016:12345-0@lo:103: Request processed in 87us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127272.569623:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789127272.569662:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789414016:0@lo:103: 00010000:00010000:2.0:1789127272.571114:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d22c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d233 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.571123:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127272.571154:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d22c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d233 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.571162:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d22c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d233 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.571190:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127272.571192:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127272.571194:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127272.571212:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127272.571228:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789414144:0@lo:103: 00000100:00100000:2.0:1789127272.571277:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127272.571321:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789414144 00000100:00100000:2.0:1789127272.571327:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789414144 00010000:00010000:2.0:1789127272.571349:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346c214d800/0xd718aadfd785d233 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d22c expref: 16 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127272.571375:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127272.571382:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7393480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:3651:x1876035789414144:12345-0@lo:103: 00010000:00010000:2.0:1789127272.571392:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127272.571396:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346c214d800/0xd718aadfd785d233 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d22c expref: 16 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.571406:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346c214d800/0xd718aadfd785d233 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d22c expref: 16 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.571421:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.571436:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789127272.571450:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005207987s 00010000:00010000:2.0:1789127272.571455:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.571461:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.571467:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.571473:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.571479:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214c600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127272.571482:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.571490:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.571497:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.571523:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127272.574137:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7393480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:3651:x1876035789414144:12345-0@lo:103: Request processed in 2745us (2849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127272.574472:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127272.574598:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789414144:0@lo:103: 00010000:00010000:2.0:1789127272.574640:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928ff600/0xd718aadfd785d24f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d248 expref: 15 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127272.574654:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a30c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1876035789413760:0@lo:104: 00010000:00010000:2.0:1789127272.574666:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346c214d800/0xd718aadfd785d233 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d22c expref: 14 pid: 6516 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127272.574676:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1876035789413888:0@lo:104: 00010000:00010000:2.0:1789127272.574694:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.575261:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.575277:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.575284:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346c214c600/0xd718aadfd785d33d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127272.575311:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1789127272.588554:0:8431:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1789127272.589130:0:8431:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789127272.590099:0:8431:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1789127272.590362:0:8431:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:2.0:1789127272.596594:0:8431:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789127272.597141:0:8431:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789127272.599315:0:8431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789127272.621887:0:8431:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789127272.621895:0:8431:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789127272.621933:0:8431:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789127272.621978:0:8431:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789127272.622000:0:8431:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789127272.622017:0:8431:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789127272.622793:0:8431:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127272.622961:0:8431:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1789127273.400838:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127273.793727:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127273.793753:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586046d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789414272:0@lo:41: 00000100:00100000:0.0:1789127273.793818:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127273.793899:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789414272 00000100:00100000:0.0:1789127273.793906:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789414272 00000100:00100000:0.0:1789127273.793950:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789127273.793958:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586044f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789414272:12345-0@lo:41: 00000004:00000024:0.0:1789127273.794213:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789127273.794267:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586044f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789414272:12345-0@lo:41: Request processed in 309us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127273.794274:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127273.794348:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586046d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789414272:0@lo:41: 00000020:00000004:3.0:1789127274.132418:0:8516:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127274.132645:0:8516:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789127274.299740:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127274.299765:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789414400:0@lo:41: 00000100:00100000:1.0:1789127274.299832:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127274.299893:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789414400 00000100:00100000:1.0:1789127274.299899:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789414400 00000100:00100000:1.0:1789127274.299940:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789127274.299949:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789414400:12345-0@lo:41: 00000004:00000024:1.0:1789127274.299980:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789127274.300025:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789414400:12345-0@lo:41: Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127274.300033:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789127274.300078:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789414400:0@lo:41: 00010000:00010000:2.0:1789127274.423688:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127275.454713:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127276.485003:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127277.496624:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127277.884282:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789414656:0@lo:400: 00000100:00100000:2.0:1789127277.884346:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127277.884413:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789415168:0@lo:400: 00000100:00100000:2.0:1789127277.884438:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127277.884465:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789127277.884471:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7393840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789414784:0@lo:400: 00000100:00100000:2.0:1789127277.884496:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127277.884550:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789415296:0@lo:400: 00000100:00100000:2.0:1789127277.884572:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127277.884604:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789414656 00000100:00100000:2.0:1789127277.884610:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789414656 00000100:00100000:2.0:1789127277.884645:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789415168 00000100:00100000:2.0:1789127277.884647:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789415168 00000100:00100000:2.0:1789127277.884675:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789415296 00000100:00100000:2.0:1789127277.884679:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789415296 00000100:00100000:2.0:1789127277.884694:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789127277.884702:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789414656:12345-0@lo:400: 00000100:00100000:2.0:1789127277.884749:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789414656:12345-0@lo:400: Request processed in 48us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127277.884757:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789127277.884773:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127277.884779:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789415168:12345-0@lo:400: 00000100:00100000:2.0:1789127277.884806:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789415168:12345-0@lo:400: Request processed in 28us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127277.884812:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127277.884822:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789127277.884827:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789415296:12345-0@lo:400: 00000100:00100000:2.0:1789127277.884851:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789415296:12345-0@lo:400: Request processed in 25us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127277.884866:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127277.885038:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789414912:0@lo:400: 00000100:00100000:3.0:1789127277.885069:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127277.885090:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789127277.885096:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789414528:0@lo:400: 00000100:00100000:3.0:1789127277.885120:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127277.885153:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789415040:0@lo:400: 00000100:00100000:3.0:1789127277.885176:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127277.885204:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789414528 00000100:00100000:3.0:1789127277.885209:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789414528 00000100:00100000:3.0:1789127277.885235:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789127277.885241:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:3652:x1876035789414528:12345-0@lo:400: 00000100:00100000:3.0:1789127277.885290:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:3652:x1876035789414528:12345-0@lo:400: Request processed in 48us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127277.885296:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789127277.885320:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789414784 00000100:00100000:3.0:1789127277.885323:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789414784 00000100:00100000:3.0:1789127277.885342:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789415040 00000100:00100000:3.0:1789127277.885344:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789415040 00000100:00100000:3.0:1789127277.885356:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789127277.885361:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789414784:12345-0@lo:400: 00000100:00100000:3.0:1789127277.885390:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789414784:12345-0@lo:400: Request processed in 29us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127277.885396:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789127277.885407:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789127277.885413:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789415040:12345-0@lo:400: 00000100:00100000:3.0:1789127277.885448:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789415040:12345-0@lo:400: Request processed in 35us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127277.885454:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789127277.885487:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789414528:0@lo:400: 00000100:00100000:3.0:1789127277.885500:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789415040:0@lo:400: 00000100:00100000:3.0:1789127277.885562:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789414912 00000100:00100000:3.0:1789127277.885566:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789414912 00000100:00080000:0.0:1789127277.885647:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127277.885652:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127277.885687:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7393840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789414784:0@lo:400: 00010000:00080000:0.0:1789127277.885705:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b7392580 x1876035789415296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127277.885715:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789415296:0@lo:400: 00010000:00080000:0.0:1789127277.885726:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b7390f00 x1876035789414656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127277.885734:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789414656:0@lo:400: 00010000:00080000:0.0:1789127277.885746:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b7390b40 x1876035789415168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127277.885754:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789415168:0@lo:400: 00000100:00100000:3.0:1789127277.898283:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127277.898307:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789414912:12345-0@lo:400: 00000100:00100000:3.0:1789127277.898414:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789414912:12345-0@lo:400: Request processed in 120us (13343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127277.898421:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789127277.898793:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b73903c0 x1876035789414912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127293 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127277.898809:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789414912:0@lo:400: 00010000:00010000:0.0:1789127278.528265:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127278.927106:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789415424:0@lo:41: 00000100:00100000:2.0:1789127278.927187:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127278.927385:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789415424 00000100:00100000:0.0:1789127278.927393:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789415424 00000100:00100000:0.0:1789127278.927447:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127278.927458:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789415424:12345-0@lo:41: 00000004:00000024:0.0:1789127278.927491:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789127278.927565:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789415424:12345-0@lo:41: Request processed in 108us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127278.927586:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127278.927628:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789415424:0@lo:41: 10000000:01000000:2.0:1789127279.416504:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789127279.416540:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9346b640b000 from 30 10000000:01000000:2.0:1789127279.416545:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789127279.416587:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127279.416598:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127279.416608:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127279.416630:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789415552:0@lo:101: 00000100:00100000:2.0:1789127279.416692:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127279.416748:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127279.416767:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789415552 00000100:00100000:2.0:1789127279.416773:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789415552 00000100:00100000:2.0:1789127279.416818:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789127279.416826:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:6520:x1876035789415552:12345-0@lo:101: 00010000:00010000:2.0:1789127279.416838:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127279.416849:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928ff000/0xd718aadfd785d34b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d344 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127279.416885:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928ff000/0xd718aadfd785d34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d344 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127279.416895:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928ff000/0xd718aadfd785d34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d344 expref: 15 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127279.416915:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff000, rc 0) 00000100:00100000:2.0:1789127279.416953:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:6520:x1876035789415552:12345-0@lo:101: Request processed in 128us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127279.416961:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789127279.417007:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789415552:0@lo:101: 00010000:00010000:2.0:1789127279.417032:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d34b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127279.417042:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d34b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127279.417095:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789415680:0@lo:501: 00000100:00100000:2.0:1789127279.417120:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127279.417156:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127279.417434:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789415680 00000100:00100000:3.0:1789127279.417439:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789415680 00000100:00100000:3.0:1789127279.417468:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789127279.417475:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:6520:x1876035789415680:12345-0@lo:501: 00000100:00100000:3.0:1789127279.417606:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:6520:x1876035789415680:12345-0@lo:501: Request processed in 130us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.417613:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789127279.421221:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692922580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789415808:0@lo:41: 00000100:00100000:3.0:1789127279.421282:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127279.421339:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789415808 00000100:00100000:3.0:1789127279.421345:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789415808 00000100:00100000:3.0:1789127279.421384:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789127279.421392:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692921e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789415808:12345-0@lo:41: 00000004:00000024:3.0:1789127279.421420:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789127279.421471:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692921e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789415808:12345-0@lo:41: Request processed in 78us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.421478:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789127279.421541:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692922580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789415808:0@lo:41: 00000100:00100000:2.0:1789127279.422688:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789415680:0@lo:501: 00000100:00100000:2.0:1789127279.422755:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789415936:0@lo:503: 00000100:00100000:2.0:1789127279.422807:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127279.422838:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127279.423248:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789415936 00000100:00100000:3.0:1789127279.423255:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789415936 00000100:00100000:3.0:1789127279.423306:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789127279.423315:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:6520:x1876035789415936:12345-0@lo:503: 00000100:00100000:3.0:1789127279.423411:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:6520:x1876035789415936:12345-0@lo:503: Request processed in 97us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.423419:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789127279.423500:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789415936:0@lo:503: 00000100:00100000:2.0:1789127279.424467:0:8745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8745:1876035789416064:0@lo:502: 00000100:00100000:2.0:1789127279.424559:0:8745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127279.428757:0:8745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127279.428933:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789416064 00000100:00100000:3.0:1789127279.428941:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789416064 00000100:00100000:3.0:1789127279.428994:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789127279.429004:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8745:x1876035789416064:12345-0@lo:502: 00000100:00100000:3.0:1789127279.429176:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8745:x1876035789416064:12345-0@lo:502: Request processed in 173us (4617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.429184:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789127279.430705:0:8745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8745:1876035789416064:0@lo:502: 00000100:00100000:2.0:1789127279.430777:0:8745:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8745:1876035789416192:0@lo:502: 00000100:00100000:2.0:1789127279.430832:0:8745:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127279.430867:0:8745:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127279.433947:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789416192 00000100:00100000:3.0:1789127279.433960:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789416192 00000100:00100000:3.0:1789127279.434006:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789127279.434014:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8745:x1876035789416192:12345-0@lo:502: 00000100:00100000:3.0:1789127279.434175:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:8745:x1876035789416192:12345-0@lo:502: Request processed in 161us (3343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.434183:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789127279.434237:0:8745:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8745:1876035789416192:0@lo:502: 00000040:00080000:3.0:1789127279.434272:0:8745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789127279.434339:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789127279.434359:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127279.434368:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d34b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.434378:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d34b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127279.434386:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789127279.434388:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9346b640b000 from 5 10000000:01000000:3.0:1789127279.434391:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789127279.434418:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.434424:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.434433:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127279.434449:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692922580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789416320:0@lo:101: 00000100:00100000:3.0:1789127279.434481:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127279.434531:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b726b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789127279.434549:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789416320 00000100:00100000:3.0:1789127279.434553:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789416320 00000100:00100000:3.0:1789127279.434582:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789127279.434590:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:6520:x1876035789416320:12345-0@lo:101: 00010000:00010000:3.0:1789127279.434598:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127279.434609:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d359 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d352 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.434648:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d352 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.434658:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d352 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.434667:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a0e00, rc 0) 00000100:00100000:3.0:1789127279.434716:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789416320:12345-0@lo:101: Request processed in 119us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.434723:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789127279.434809:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692922580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789416320:0@lo:101: 00010000:00010000:1.0:1789127279.434823:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d359 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127279.434831:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d359 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127279.434885:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789416448:0@lo:256: 00000100:00100000:1.0:1789127279.434919:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127279.434945:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346852b3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127279.435013:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789416448 00000100:00100000:3.0:1789127279.435018:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789416448 00000100:00100000:3.0:1789127279.435118:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789127279.435141:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789416448:12345-0@lo:256: 20000000:01000000:3.0:1789127279.435154:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789127279.435168:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789127279.435171:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1789127279.435242:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789416448:12345-0@lo:256: Request processed in 117us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.435249:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789127279.438124:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789416448:0@lo:256: 10000000:01000000:1.0:1789127279.438813:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789127279.438823:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d359 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127279.438833:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d359 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127279.438843:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789127279.438845:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:1.0:1789127279.438848:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789127279.438880:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127279.438888:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127279.438896:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127279.438981:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789416576:0@lo:101: 00000100:00100000:1.0:1789127279.439104:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127279.439213:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346852b3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127279.439235:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789416576 00000100:00100000:1.0:1789127279.439248:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789416576 00000100:00100000:1.0:1789127279.439285:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789127279.439293:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789416576:12345-0@lo:101: 00010000:00010000:1.0:1789127279.439305:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127279.439318:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346c214d800/0xd718aadfd785d367 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d360 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127279.439338:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346c214d800/0xd718aadfd785d367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d360 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127279.439347:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346c214d800/0xd718aadfd785d367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d360 expref: 17 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127279.439355:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214d800, rc 0) 00000100:00100000:1.0:1789127279.439391:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789416576:12345-0@lo:101: Request processed in 98us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127279.439397:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789127279.439437:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789416576:0@lo:101: 00010000:00010000:1.0:1789127279.439448:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d367 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127279.439458:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d367 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127279.439535:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789416704:0@lo:501: 00000100:00100000:1.0:1789127279.439561:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127279.439657:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346852b3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127279.439670:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789416704 00000100:00100000:1.0:1789127279.439673:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789416704 00000100:00100000:1.0:1789127279.439696:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789127279.439701:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789416704:12345-0@lo:501: 00000100:00100000:1.0:1789127279.439817:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789416704:12345-0@lo:501: Request processed in 115us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127279.439824:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789127279.439851:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789416704:0@lo:501: 00000100:00100000:1.0:1789127279.441125:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789416832:0@lo:503: 00000100:00100000:1.0:1789127279.441251:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127279.441283:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346852b3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127279.441302:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789416832 00000100:00100000:1.0:1789127279.441307:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789416832 00000100:00100000:1.0:1789127279.441337:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789127279.441344:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789416832:12345-0@lo:503: 00000100:00100000:1.0:1789127279.441434:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789416832:12345-0@lo:503: Request processed in 89us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127279.441440:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789127279.441488:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789416832:0@lo:503: 00000100:00100000:0.0:1789127279.445753:0:8746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8746:1876035789416960:0@lo:502: 00000100:00100000:0.0:1789127279.445828:0:8746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127279.445865:0:8746:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346989c4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127279.446773:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789416960 00000100:00100000:1.0:1789127279.446781:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789416960 00000100:00100000:1.0:1789127279.446821:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789127279.446829:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:8746:x1876035789416960:12345-0@lo:502: 00000100:00100000:1.0:1789127279.447009:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:8746:x1876035789416960:12345-0@lo:502: Request processed in 180us (1181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127279.447017:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789127279.447241:0:8746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8746:1876035789416960:0@lo:502: 00000020:01000000:0.0:1789127279.447277:0:8746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789127279.447285:0:8746:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789127279.447291:0:8746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127279.447293:0:8746:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789127279.447299:0:8746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789127279.447302:0:8746:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:0.0:1789127279.447322:0:8746:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789127279.447327:0:8746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127279.447346:0:8746:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9346aeec9a48) 00000020:00000080:0.0:1789127279.447366:0:8746:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1789127279.447371:0:8746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789127279.447457:0:8746:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789127279.447463:0:8746:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789127279.447468:0:8746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd718aadfd785d375 00010000:00080000:0.0:1789127279.447496:0:8746:0:(ldlm_lib.c:102:import_set_conn()) imp ffff934586ebe000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.148@tcp at head 00010000:00010000:0.0:1789127279.448744:0:8746:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789127279.461488:0:8746:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789127279.461551:0:8746:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789127279.462271:0:8746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127279.462480:0:8746:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127279.462591:0:8746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789127279.462679:0:8746:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789127279.466498:0:8747:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789127279.466505:0:8747:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789127279.469811:0:8746:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789127279.469824:0:8746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789127279.469868:0:8746:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789127279.469891:0:8746:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd718aadfd785d37c 00000100:00080000:0.0:1789127279.469911:0:8746:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127279.469917:0:8746:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff934586ebe000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789127279.469961:0:8746:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934586047480 x1876035789417088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127279.469983:0:8746:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789127279.470050:0:8746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127279.470054:0:8746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127279.470055:0:8746:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789127279.470059:0:8746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127279.470062:0:8746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127279.470064:0:8746:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789127279.470066:0:8746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789127279.470068:0:8746:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789127279.470095:0:8746:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586044780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8746:1876035789417216:0@lo:502: 00000100:00100000:0.0:1789127279.470354:0:8746:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127279.470399:0:8746:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346833a6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127279.470493:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789417088:0@lo:8: 00000100:00100000:3.0:1789127279.470548:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127279.470746:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789417216 00000100:00100000:1.0:1789127279.470753:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789417216 00000100:00100000:1.0:1789127279.470796:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789127279.470805:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:8746:x1876035789417216:12345-0@lo:502: 00000100:00100000:1.0:1789127279.471233:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:8746:x1876035789417216:12345-0@lo:502: Request processed in 428us (878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127279.471241:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789127279.471380:0:8746:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586044780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8746:1876035789417216:0@lo:502: 00000020:01000000:3.0:1789127279.471406:0:8746:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127279.471411:0:8746:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127279.471413:0:8746:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789127279.471417:0:8746:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:1.0:1789127279.471794:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1789127279.471819:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789127279.471829:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d367 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127279.471839:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d367 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127279.471849:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789127279.471851:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff934687bf9800 from 30 10000000:01000000:1.0:1789127279.471854:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789127279.471880:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127279.471887:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127279.471895:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127279.471976:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789417344:0@lo:101: 00000100:00100000:1.0:1789127279.472013:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127279.472147:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346852b3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127279.472856:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789417088 00000100:00100000:0.0:1789127279.472864:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789417088 00000100:00100000:0.0:1789127279.472909:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127279.472916:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3649:x1876035789417088:12345-0@lo:8: 00010000:00080000:0.0:1789127279.472940:0:8438:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:0.0:1789127279.472967:0:8438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd718aadfd785d38a 00002000:00100000:0.0:1789127279.473003:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff934586eb8800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113987 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1789127279.473008:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1789127279.473012:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789127279.473079:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789127279.473314:0:8438:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1789127279.473338:0:8438:0:(import.c:65:import_set_state_nolock()) ffff934586ebf000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127279.473401:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1876035789417088:12345-0@lo:8: Request processed in 484us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127279.473416:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789127279.473463:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934586047480 x1876035789417088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127279.473475:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789127279.473481:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789127279.473489:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789127279.473493:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789127279.473496:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934586ebe000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789127279.473534:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789127279.473539:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789417088:0@lo:8: 00000004:00080000:0.0:1789127279.473565:0:8747:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789127279.473609:0:8747:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 240666099229ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789127279.473616:0:8747:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789127279.477976:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789417600:0@lo:400: 00000100:00100000:2.0:1789127279.478046:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127279.478081:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127279.478086:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789417472:0@lo:400: 00000100:00100000:2.0:1789127279.478105:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127279.478126:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789417728:0@lo:400: 00000100:00100000:2.0:1789127279.478315:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127279.478332:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127279.478337:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789417856:0@lo:400: 00000100:00100000:2.0:1789127279.478356:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127279.478379:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789417600 00000100:00100000:2.0:1789127279.478385:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789417600 00000100:00100000:2.0:1789127279.478420:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789417472 00000100:00100000:2.0:1789127279.478422:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789417472 00000100:00100000:2.0:1789127279.478432:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789417728 00000100:00100000:2.0:1789127279.478434:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789417728 00000100:00100000:2.0:1789127279.478453:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789417856 00000100:00100000:2.0:1789127279.478456:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789417856 00000100:00100000:2.0:1789127279.478469:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789127279.478476:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789417600:12345-0@lo:400: 00000100:00100000:2.0:1789127279.478560:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789417600:12345-0@lo:400: Request processed in 83us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127279.478568:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789127279.478585:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127279.478592:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789417472:12345-0@lo:400: 00000100:00100000:2.0:1789127279.478617:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789417472:12345-0@lo:400: Request processed in 26us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127279.478622:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127279.478633:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789127279.478638:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789417728:12345-0@lo:400: 00000100:00100000:2.0:1789127279.478666:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789417728:12345-0@lo:400: Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127279.478672:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789127279.478682:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789127279.478688:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789417856:12345-0@lo:400: 00000100:00100000:2.0:1789127279.478773:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789417856:12345-0@lo:400: Request processed in 84us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127279.478779:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789127279.478825:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b72a8000 x1876035789417472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127279.478839:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789417472:0@lo:400: 00010000:00080000:2.0:1789127279.478849:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b72aa940 x1876035789417600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127279.478856:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789417600:0@lo:400: 00010000:00080000:2.0:1789127279.478896:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934692b4da40 x1876035789417856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789127279.479291:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127279.479296:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127279.479431:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789417856:0@lo:400: 00010000:00080000:2.0:1789127279.479449:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934692b4f840 x1876035789417728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127279.479457:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789417728:0@lo:400: 00000100:00100000:3.0:1789127279.482832:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789417344 00000100:00100000:3.0:1789127279.482844:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789417344 00000100:00100000:3.0:1789127279.482891:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789127279.482911:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789417344:12345-0@lo:101: 00010000:00010000:3.0:1789127279.482927:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127279.482943:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d391 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d383 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.482968:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d383 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.482978:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d383 expref: 18 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.482986:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a0800, rc 0) 00000100:00100000:3.0:1789127279.483184:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789417344:12345-0@lo:101: Request processed in 285us (11170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.483192:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789127279.483273:0:8748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692922580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8748:1876035789417984:0@lo:700: 00000100:00100000:3.0:1789127279.483306:0:8748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127279.483338:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789417984 00000100:00100000:3.0:1789127279.483342:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789417984 00000100:00100000:3.0:1789127279.483375:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127279.483382:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8748:x1876035789417984:12345-0@lo:700: 00000100:00100000:3.0:1789127279.483410:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390b40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8446:1876035789418112:0@lo:700: 00000100:00100000:3.0:1789127279.483439:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127279.483456:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b726b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789127279.483470:0:8748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b726b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127279.483850:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789417344:0@lo:101: 00010000:00010000:1.0:1789127279.483875:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d391 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127279.483886:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d391 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127279.483955:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789418240:0@lo:501: 00000100:00100000:1.0:1789127279.483985:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127279.484014:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346852b3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127279.484041:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789418112 00000100:00100000:1.0:1789127279.484045:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789418112 00000100:00100000:1.0:1789127279.484075:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127279.484082:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7390f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8446:x1876035789418112:12345-0@lo:700: 00000100:00100000:3.0:1789127279.484808:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789418240 00000100:00100000:3.0:1789127279.484814:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789418240 00000100:00100000:3.0:1789127279.484841:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789127279.484848:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789418240:12345-0@lo:501: 00000004:00080000:1.0:1789127279.485254:0:7454:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00080000:0.0:1789127279.485385:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127279.486965:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789418240:12345-0@lo:501: Request processed in 2044us (2906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.486980:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789127279.487815:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789418240:0@lo:501: 00000100:00100000:1.0:1789127279.487874:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789418368:0@lo:503: 00000100:00100000:1.0:1789127279.487993:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127279.488535:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346852b3a80 going to sleep for 11 seconds 40000000:02000000:1.0:1789127279.495105:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:0.0:1789127279.500983:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789418368 00000100:00100000:0.0:1789127279.500997:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789418368 00000100:00100000:0.0:1789127279.501070:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789127279.501080:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789418368:12345-0@lo:503: 00000100:00100000:0.0:1789127279.501248:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789418368:12345-0@lo:503: Request processed in 170us (13255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127279.501256:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789127279.505262:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789418368:0@lo:503: 00000100:00100000:1.0:1789127279.505404:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7390f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8446:x1876035789418112:12345-0@lo:700: Request processed in 21321us (21962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127279.505415:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789127279.505459:0:8446:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b7390b40 x1876035789418112/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789127295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127279.505472:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390b40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8446:1876035789418112:0@lo:700: 40000000:02000000:1.0:1789127279.505489:0:8446:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1789127279.510030:0:8749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8749:1876035789418496:0@lo:502: 00000100:00100000:0.0:1789127279.510121:0:8749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127279.510181:0:8749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346833a6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127279.510584:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789418496 00000100:00100000:3.0:1789127279.510592:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789418496 00000100:00100000:3.0:1789127279.510631:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789127279.510641:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:8749:x1876035789418496:12345-0@lo:502: 00000100:00100000:3.0:1789127279.510887:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:8749:x1876035789418496:12345-0@lo:502: Request processed in 246us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.510894:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789127279.511060:0:8749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8749:1876035789418496:0@lo:502: 00000100:00100000:0.0:1789127279.511122:0:8749:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8749:1876035789418624:0@lo:502: 00000100:00100000:0.0:1789127279.511172:0:8749:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127279.511205:0:8749:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346833a6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127279.511355:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789418624 00000100:00100000:3.0:1789127279.511361:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789418624 00000100:00100000:3.0:1789127279.511397:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789127279.511404:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:8749:x1876035789418624:12345-0@lo:502: 00000100:00100000:3.0:1789127279.511476:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:8749:x1876035789418624:12345-0@lo:502: Request processed in 73us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.511483:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789127279.513113:0:8749:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8749:1876035789418624:0@lo:502: 00000040:00080000:0.0:1789127279.513163:0:8749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789127279.513390:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789127279.513411:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127279.513422:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d391 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.513433:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d391 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127279.513460:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789127279.513463:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff934687bf9800 from 5 10000000:01000000:3.0:1789127279.513466:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789127279.513496:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.513504:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.513547:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127279.513577:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789418752:0@lo:101: 00000100:00100000:3.0:1789127279.513626:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127279.513654:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586decc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127279.513872:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789418752 00000100:00100000:0.0:1789127279.513878:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789418752 00000100:00100000:0.0:1789127279.513986:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789127279.513996:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789418752:12345-0@lo:101: 00010000:00010000:0.0:1789127279.514008:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127279.514114:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346813c9e00/0xd718aadfd785d39f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d398 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127279.514151:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346813c9e00/0xd718aadfd785d39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d398 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127279.514162:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346813c9e00/0xd718aadfd785d39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d398 expref: 19 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127279.514170:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346813c9e00, rc 0) 00000100:00100000:0.0:1789127279.514247:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:6520:x1876035789418752:12345-0@lo:101: Request processed in 252us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127279.514255:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789127279.524791:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789418752:0@lo:101: 00010000:00010000:3.0:1789127279.524822:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d39f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.524834:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d39f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127279.525209:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789418880:0@lo:256: 00000100:00100000:3.0:1789127279.525279:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127279.525317:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586decc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127279.525462:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789418880 00000100:00100000:0.0:1789127279.525469:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789418880 00000100:00100000:0.0:1789127279.525538:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789127279.525548:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:6520:x1876035789418880:12345-0@lo:256: 20000000:01000000:0.0:1789127279.525567:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789127279.525589:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789127279.525592:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789127279.525672:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:6520:x1876035789418880:12345-0@lo:256: Request processed in 126us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127279.525681:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789127279.526651:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789418880:0@lo:256: 10000000:01000000:3.0:1789127279.526720:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789127279.526736:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d39f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.526745:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d39f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127279.526753:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789127279.526755:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789127279.526758:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789127279.526785:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.526792:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.526801:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127279.526818:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789419008:0@lo:101: 00000100:00100000:3.0:1789127279.526856:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127279.526887:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586decc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127279.527502:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789419008 00000100:00100000:0.0:1789127279.527522:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789419008 00000100:00100000:0.0:1789127279.527560:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789127279.527568:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:6520:x1876035789419008:12345-0@lo:101: 00010000:00010000:0.0:1789127279.527579:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127279.527592:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346813c8000/0xd718aadfd785d3ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d3a6 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127279.527613:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346813c8000/0xd718aadfd785d3ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d3a6 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127279.527623:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346813c8000/0xd718aadfd785d3ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d3a6 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127279.527631:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346813c8000, rc 0) 00000100:00100000:0.0:1789127279.527680:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789419008:12345-0@lo:101: Request processed in 112us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127279.527686:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789127279.527981:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789419008:0@lo:101: 00010000:00010000:3.0:1789127279.527995:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d3ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.528004:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d3ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127279.528236:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789419136:0@lo:501: 00000100:00100000:3.0:1789127279.528278:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127279.528304:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586decc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127279.528318:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789419136 00000100:00100000:3.0:1789127279.528322:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789419136 00000100:00100000:3.0:1789127279.528343:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789127279.528350:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789419136:12345-0@lo:501: 00000100:00100000:3.0:1789127279.528454:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789419136:12345-0@lo:501: Request processed in 105us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.528460:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789127279.528492:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789419136:0@lo:501: 00000100:00100000:3.0:1789127279.528536:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789419264:0@lo:503: 00000100:00100000:3.0:1789127279.528575:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127279.528587:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586decc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127279.528598:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789419264 00000100:00100000:3.0:1789127279.528601:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789419264 00000100:00100000:3.0:1789127279.528617:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789127279.528623:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789419264:12345-0@lo:503: 00000100:00100000:3.0:1789127279.528699:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789419264:12345-0@lo:503: Request processed in 75us (122us total) trans 0 rc 0/0 00000001:00100000:1.0:1789127279.528825:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789127279.528888:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8748:x1876035789417984:12345-0@lo:700: Request processed in 45506us (45580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127279.529022:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127279.532627:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789127279.533632:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789419264:0@lo:503: 00010000:00080000:3.0:1789127279.534604:0:8748:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934692922580 x1876035789417984/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789127295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127279.534626:0:8748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692922580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8748:1876035789417984:0@lo:700: 00010000:00010000:2.0:1789127279.543925:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127279.545143:0:8752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8752:1876035789419392:0@lo:502: 00000100:00100000:0.0:1789127279.545224:0:8752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127279.545259:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789419392 00000100:00100000:0.0:1789127279.545265:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789419392 00000100:00100000:0.0:1789127279.545308:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789127279.545316:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:8752:x1876035789419392:12345-0@lo:502: 00000100:00100000:0.0:1789127279.545428:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:8752:x1876035789419392:12345-0@lo:502: Request processed in 113us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127279.545436:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789127279.545495:0:8752:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a06ae840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127279.545534:0:8752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8752:1876035789419392:0@lo:502: 00000020:01000000:0.0:1789127279.545565:0:8752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789127279.545572:0:8752:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789127279.545579:0:8752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127279.545581:0:8752:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789127279.545586:0:8752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789127279.545590:0:8752:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:0.0:1789127279.545609:0:8752:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789127279.545612:0:8752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127279.545632:0:8752:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9346aed19a48) 00000020:00000080:0.0:1789127279.545653:0:8752:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:0.0:1789127279.545660:0:8752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789127279.545743:0:8752:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789127279.545749:0:8752:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789127279.545755:0:8752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785d3bb 00010000:00080000:0.0:1789127279.545782:0:8752:0:(ldlm_lib.c:102:import_set_conn()) imp ffff934586075800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:0.0:1789127279.546635:0:8752:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000040:01000000:0.0:1789127279.556927:0:8752:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789127279.556948:0:8752:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789127279.557146:0:8752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127279.557315:0:8752:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127279.557389:0:8752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789127279.557466:0:8752:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000004:00080000:0.0:1789127279.558595:0:8748:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789127279.558626:0:8748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586044000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8748:1876035789419648:0@lo:7: 00000100:00100000:0.0:1789127279.558699:0:8748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127279.558752:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789419648 00000100:00100000:2.0:1789127279.558757:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127279.558759:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789419648 00000100:00100000:2.0:1789127279.558771:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789419520:0@lo:13: 00000100:00100000:0.0:1789127279.558798:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127279.558803:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127279.558806:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586044b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8748:x1876035789419648:12345-0@lo:7: 00000100:00100000:1.0:1789127279.561827:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789419520 00000100:00100000:1.0:1789127279.561839:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789419520 00000100:00100000:1.0:1789127279.561893:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127279.561912:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692957c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1876035789419520:12345-0@lo:13: 00002000:00000024:1.0:1789127279.561940:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923935232 avail 3692412928 00000100:00100000:1.0:1789127279.562020:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692957c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1876035789419520:12345-0@lo:13: Request processed in 119us (3214us total) trans 0 rc 0/0 00010000:00080000:2.0:1789127279.562054:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934586047480 x1876035789419520/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127279.562075:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789419520:0@lo:13: 00000100:00100000:1.0:1789127279.563005:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127279.569299:0:8748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a06ae180 going to sleep for 11 seconds 00000040:00080000:3.0:1789127279.569432:0:8753:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789127279.569443:0:8753:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789127279.572081:0:8752:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789127279.572095:0:8752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789127279.572321:0:8752:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789127279.572351:0:8752:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd718aadfd785d3c2 00000100:00080000:3.0:1789127279.572362:0:8752:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127279.572369:0:8752:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff934586075800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789127279.572404:0:8752:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9346b7392580 x1876035789419776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127279.572474:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789419776:0@lo:8: 00000100:00100000:2.0:1789127279.572562:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789127279.572639:0:8752:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789127279.572701:0:8752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127279.572706:0:8752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127279.572708:0:8752:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789127279.572712:0:8752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127279.572715:0:8752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127279.572716:0:8752:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789127279.572719:0:8752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789127279.572720:0:8752:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789127279.572744:0:8752:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7393840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8752:1876035789419904:0@lo:502: 00000100:00100000:3.0:1789127279.572788:0:8752:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127279.572816:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789419904 00000100:00100000:3.0:1789127279.572822:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789419904 00000100:00100000:3.0:1789127279.572865:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789127279.572874:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:8752:x1876035789419904:12345-0@lo:502: 00000100:00100000:3.0:1789127279.572985:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:8752:x1876035789419904:12345-0@lo:502: Request processed in 112us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.572992:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789127279.574277:0:8752:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dec600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127279.574313:0:8752:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7393840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:8752:1876035789419904:0@lo:502: 00000020:01000000:3.0:1789127279.574352:0:8752:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127279.574359:0:8752:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127279.574360:0:8752:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789127279.574364:0:8752:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1789127279.574438:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789127279.574460:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789127279.574470:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d3ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.574479:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d3ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127279.574488:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789127279.574490:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9346b18f3490 from 1 10000000:01000000:3.0:1789127279.574493:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789127279.574536:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.574544:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127279.574552:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127279.574567:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7393840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789420032:0@lo:101: 00000100:00100000:3.0:1789127279.574612:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127279.574639:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dec600 going to sleep for 11 seconds 00000100:00100000:0.0:1789127279.574925:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789420032 00000100:00100000:0.0:1789127279.574932:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789420032 00000100:00100000:0.0:1789127279.574978:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789127279.574987:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789420032:12345-0@lo:101: 00010000:00010000:0.0:1789127279.574998:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127279.575010:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346813c9c00/0xd718aadfd785d3d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d3c9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127279.575043:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346813c9c00/0xd718aadfd785d3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d3c9 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127279.575054:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346813c9c00/0xd718aadfd785d3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d3c9 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127279.575062:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346813c9c00, rc 0) 00000100:00100000:0.0:1789127279.575101:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789420032:12345-0@lo:101: Request processed in 115us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127279.575109:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789127279.575673:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7393840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789420032:0@lo:101: 00010000:00010000:0.0:1789127279.575689:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d3d0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127279.575699:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d3d0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127279.575773:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586046580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789420160:0@lo:501: 00000100:00100000:0.0:1789127279.575802:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127279.575827:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b6477e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127279.575840:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789420160 00000100:00100000:0.0:1789127279.575843:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789420160 00000100:00100000:0.0:1789127279.575867:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789127279.575873:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789420160:12345-0@lo:501: 00000100:00100000:0.0:1789127279.575941:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789420160:12345-0@lo:501: Request processed in 67us (138us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127279.575948:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789127279.575976:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586046580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789420160:0@lo:501: 10000000:01000000:0.0:1789127279.575998:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789127279.576003:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d3d0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127279.576011:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d3d0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127279.578600:0:8439:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789127279.578611:0:8439:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789127279.578702:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789419776 00000100:00100000:3.0:1789127279.578719:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789419776 00000100:00100000:3.0:1789127279.578820:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127279.578828:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692956d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3649:x1876035789419776:12345-0@lo:8: 00010000:00080000:3.0:1789127279.578856:0:8755:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:3.0:1789127279.578883:0:8755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd718aadfd785d3d7 00002000:00100000:3.0:1789127279.578896:0:8755:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9345862ed000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113987 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789127279.578900:0:8755:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789127279.578903:0:8755:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789127279.578955:0:8755:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789127279.578980:0:8755:0:(import.c:65:import_set_state_nolock()) ffff9345862eb000 : changing import state from RECOVER to FULL 00002000:00080000:0.0:1789127279.579799:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1789127279.579805:0:8440:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789127279.579861:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586044b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8748:x1876035789419648:12345-0@lo:7: Request processed in 21054us (21160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127279.579870:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789127279.581291:0:8748:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934586044000 x1876035789419648/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789127295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127279.581307:0:8748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586044000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8748:1876035789419648:0@lo:7: 00000004:00080000:2.0:1789127279.581322:0:8748:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789127279.581361:0:8748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692956580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8748:1876035789420288:0@lo:5: 00000100:00100000:2.0:1789127279.581408:0:8748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127279.581431:0:8748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127279.581532:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789420288 00000100:00100000:2.0:1789127279.581546:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789420288 00000100:00100000:2.0:1789127279.581602:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127279.581611:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8748:x1876035789420288:12345-0@lo:5: 00002000:00080000:2.0:1789127279.581639:0:8439:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789127279.581693:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8748:x1876035789420288:12345-0@lo:5: Request processed in 83us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127279.581700:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789127279.581729:0:8748:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934692956580 x1876035789420288/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127279.581738:0:8748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692956580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8748:1876035789420288:0@lo:5: 00000004:00080000:2.0:1789127279.581748:0:8748:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:2.0:1789127279.581772:0:8748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8748:1876035789420416:0@lo:5: 00000100:00100000:2.0:1789127279.581792:0:8748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127279.581806:0:8748:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127279.581817:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789420416 00000100:00100000:2.0:1789127279.581820:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789420416 00000100:00100000:2.0:1789127279.581840:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127279.581847:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692956580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8748:x1876035789420416:12345-0@lo:5: 00002000:00080000:2.0:1789127279.581869:0:8438:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789127279.587297:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692956d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3649:x1876035789419776:12345-0@lo:8: Request processed in 8461us (14727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.587312:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127279.590687:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692956580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8748:x1876035789420416:12345-0@lo:5: Request processed in 8832us (8885us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789127279.590701:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789127279.591563:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b7392580 x1876035789419776/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127279.591576:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127279.591586:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789127279.591602:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789127279.591607:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789127279.591611:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934586075800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789127279.591626:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789127279.591632:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789419776:0@lo:8: 00000004:00080000:2.0:1789127279.591677:0:8753:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789127279.591744:0:8753:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 240784234295ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789127279.591750:0:8753:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00010000:00080000:3.0:1789127279.596291:0:8748:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934692b4da40 x1876035789420416/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127279.596311:0:8748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4da40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8748:1876035789420416:0@lo:5: 00000004:00080000:3.0:1789127279.596328:0:8748:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1789127279.596402:0:8748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8748:1876035789420544:0@lo:900: 00000100:00100000:3.0:1789127279.596461:0:8748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127279.596502:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789420544 00000100:00100000:3.0:1789127279.596535:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789420544 00000100:00100000:3.0:1789127279.596583:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127279.596592:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8748:x1876035789420544:12345-0@lo:900: 00000100:00100000:3.0:1789127279.596638:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8748:x1876035789420544:12345-0@lo:900: Request processed in 46us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.596645:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127279.596676:0:8748:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dec6c0 going to sleep for 11 seconds 00010000:00080000:3.0:1789127279.596691:0:8748:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b7390780 x1876035789420544/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789127295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127279.596701:0:8748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8748:1876035789420544:0@lo:900: 00000004:00080000:1.0:1789127279.601929:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1789127279.611282:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789420672:0@lo:13: 00000100:00100000:2.0:1789127279.611347:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127279.611410:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789420672 00000100:00100000:2.0:1789127279.611418:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789420672 00000100:00100000:2.0:1789127279.611467:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127279.611474:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789420672:12345-0@lo:13: 00002000:00000024:2.0:1789127279.611494:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:2.0:1789127279.611566:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789420672:12345-0@lo:13: Request processed in 92us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127279.611573:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789127279.611605:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789127279.611639:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b72aa940 x1876035789420672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127279.611657:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789420672:0@lo:13: 00000004:00080000:2.0:1789127279.611675:0:8754:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789127279.611693:0:8754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8754:1876035789420800:0@lo:7: 00000100:00100000:2.0:1789127279.611735:0:8754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127279.611762:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789420800 00000100:00100000:2.0:1789127279.611771:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789420800 00000100:00100000:2.0:1789127279.611800:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127279.611806:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8754:x1876035789420800:12345-0@lo:7: 00000100:00100000:3.0:1789127279.616239:0:8754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341b40 going to sleep for 11 seconds 00002000:00080000:2.0:1789127279.616286:0:8440:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789127279.616293:0:8440:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789127279.616423:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8754:x1876035789420800:12345-0@lo:7: Request processed in 4614us (4684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127279.616432:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789127279.616821:0:8754:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b72aa940 x1876035789420800/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789127295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127279.616836:0:8754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8754:1876035789420800:0@lo:7: 00000004:00080000:3.0:1789127279.616850:0:8754:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789127279.616900:0:8754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8754:1876035789420928:0@lo:5: 00000100:00100000:3.0:1789127279.616935:0:8754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127279.616961:0:8754:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dec6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127279.617009:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789420928 00000100:00100000:2.0:1789127279.617015:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789420928 00000100:00100000:2.0:1789127279.617056:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127279.617064:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7392580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8754:x1876035789420928:12345-0@lo:5: 00002000:00080000:2.0:1789127279.617086:0:8438:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789127279.617089:0:8438:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1789127279.627504:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1789127279.627536:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1789127279.627553:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789127279.627863:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7392580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8754:x1876035789420928:12345-0@lo:5: Request processed in 10797us (10924us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789127279.627875:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789127279.627983:0:8754:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b7390780 x1876035789420928/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127295 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127279.627994:0:8754:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789127279.628000:0:8754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8754:1876035789420928:0@lo:5: 00000004:00080000:3.0:1789127279.628016:0:8754:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789127279.628061:0:8754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8754:1876035789421056:0@lo:700: 00000100:00100000:3.0:1789127279.628094:0:8754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127279.628197:0:8754:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dec6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127279.628365:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789421056 00000100:00100000:0.0:1789127279.628371:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789421056 00000100:00100000:0.0:1789127279.628449:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127279.628457:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7393840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8754:x1876035789421056:12345-0@lo:700: 00000100:00100000:3.0:1789127279.656178:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7393840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8754:x1876035789421056:12345-0@lo:700: Request processed in 27714us (28076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127279.656205:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789127279.656308:0:8754:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b7390780 x1876035789421056/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789127295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127279.656323:0:8754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8754:1876035789421056:0@lo:700: 00000004:02000040:1.0:1789127279.661913:0:8754:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1789127279.670499:0:8754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8754:1876035789421184:0@lo:5: 00000100:00100000:0.0:1789127279.670722:0:8754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127279.670784:0:8754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b6477e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127279.671500:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789421184 00000100:00100000:3.0:1789127279.671620:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789421184 00000100:00100000:3.0:1789127279.671673:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127279.671683:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586046580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8754:x1876035789421184:12345-0@lo:5: 00002000:00080000:3.0:1789127279.678940:0:8755:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789127279.678960:0:8755:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1789127279.680450:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586046580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8754:x1876035789421184:12345-0@lo:5: Request processed in 8763us (9723us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789127279.680461:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789127279.680798:0:8754:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b73a03c0 x1876035789421184/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127279.680814:0:8754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a03c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8754:1876035789421184:0@lo:5: 00000004:00080000:1.0:1789127279.680830:0:8754:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1789127280.567615:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789127280.675459:0:8815:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000020:00000004:1.0:1789127281.590035:0:8867:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789127281.590296:0:8867:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789127281.591785:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789127282.525813:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1789127282.615770:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127283.642948:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127284.025356:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586045a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789421312:0@lo:41: 00000100:00100000:2.0:1789127284.025429:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127284.025671:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789421312 00000100:00100000:0.0:1789127284.025680:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789421312 00000100:00100000:0.0:1789127284.025730:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789127284.025740:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789421312:12345-0@lo:41: 00000004:00000024:0.0:1789127284.025775:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789127284.025836:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789421312:12345-0@lo:41: Request processed in 98us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127284.025843:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789127284.025975:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586045a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789421312:0@lo:41: 00000020:00000004:0.0:1789127284.505733:0:8968:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127284.506006:0:8968:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789127284.536753:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789421440:0@lo:41: 00000100:00100000:2.0:1789127284.536834:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127284.536998:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789421440 00000100:00100000:3.0:1789127284.537005:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789421440 00000100:00100000:3.0:1789127284.537057:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789127284.537067:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789421440:12345-0@lo:41: 00000004:00000024:3.0:1789127284.537102:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1789127284.537162:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789421440:12345-0@lo:41: Request processed in 96us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127284.537169:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789127284.537362:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789421440:0@lo:41: 00010000:00010000:0.0:1789127284.663709:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127285.049099:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127285.049136:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345860452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789421568:0@lo:13: 00000100:00100000:0.0:1789127285.049196:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127285.049258:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789421568 00000100:00100000:0.0:1789127285.049265:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789421568 00000100:00100000:0.0:1789127285.049316:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127285.049325:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586046940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789421568:12345-0@lo:13: 00002000:00000024:0.0:1789127285.049350:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127285.049389:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586046940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789421568:12345-0@lo:13: Request processed in 66us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127285.049403:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789127285.049423:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789127285.049451:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345860452c0 x1876035789421568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127285.049461:0:3651:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789127285.049484:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345860452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789421568:0@lo:13: 00000100:00100000:3.0:1789127285.051698:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692922580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789422080:0@lo:400: 00000100:00100000:3.0:1789127285.051761:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127285.051790:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789422592:0@lo:400: 00000100:00100000:3.0:1789127285.051815:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127285.051836:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789127285.051842:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789421696:0@lo:400: 00000100:00100000:3.0:1789127285.051870:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127285.051903:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789422208:0@lo:400: 00000100:00100000:3.0:1789127285.051929:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127285.051960:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789422592 00000100:00100000:3.0:1789127285.051966:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789422592 00000100:00100000:3.0:1789127285.052016:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127285.052039:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed13c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789422592:12345-0@lo:400: 00000100:00100000:3.0:1789127285.052093:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed13c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789422592:12345-0@lo:400: Request processed in 56us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127285.052298:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127285.052325:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789422208 00000100:00100000:3.0:1789127285.052329:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789422208 00000100:00100000:3.0:1789127285.052355:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789127285.052362:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789422208:12345-0@lo:400: 00000100:00100000:3.0:1789127285.052398:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789422208:12345-0@lo:400: Request processed in 36us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127285.052404:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789127285.052441:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed130c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789422208:0@lo:400: 00010000:00080000:3.0:1789127285.052454:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346aed112c0 x1876035789422592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127285.052463:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789127285.052474:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed112c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789422592:0@lo:400: 00000100:00100000:0.0:1789127285.052563:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789421696 00000100:00100000:0.0:1789127285.052568:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789421696 00000100:00100000:0.0:1789127285.052601:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789127285.052608:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3650:x1876035789421696:12345-0@lo:400: 00000100:00100000:0.0:1789127285.052645:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3650:x1876035789421696:12345-0@lo:400: Request processed in 39us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127285.052651:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1789127285.052681:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127285.052700:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789421696:0@lo:400: 00000100:00100000:3.0:1789127285.053210:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127285.053222:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789422720:0@lo:13: 00000100:00100000:3.0:1789127285.053251:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127285.053308:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789422720 00000100:00100000:0.0:1789127285.053314:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789422720 00000100:00100000:0.0:1789127285.053350:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127285.053358:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789422720:12345-0@lo:13: 00002000:00000024:0.0:1789127285.053372:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127285.053410:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed112c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789422720:12345-0@lo:13: Request processed in 53us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127285.053416:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789127285.053443:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b73a21c0 x1876035789422720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127285.053457:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789422720:0@lo:13: 00000100:00100000:3.0:1789127285.054632:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789421952:0@lo:400: 00000100:00100000:3.0:1789127285.054677:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127285.054714:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789422464:0@lo:400: 00000100:00100000:3.0:1789127285.054742:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127285.054772:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789127285.054779:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789421824:0@lo:400: 00000100:00100000:3.0:1789127285.054802:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127285.054817:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789422336:0@lo:400: 00000100:00100000:3.0:1789127285.054838:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127285.055221:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789421952 00000100:00100000:0.0:1789127285.055229:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789421952 00000100:00100000:0.0:1789127285.055271:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789127285.055280:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789421952:12345-0@lo:400: 00000100:00100000:0.0:1789127285.055348:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789421952:12345-0@lo:400: Request processed in 69us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127285.055356:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789127285.055380:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789422080 00000100:00100000:0.0:1789127285.055383:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789422080 00000100:00100000:0.0:1789127285.055401:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789422464 00000100:00100000:0.0:1789127285.055403:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789422464 00000100:00100000:0.0:1789127285.055423:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789421824 00000100:00100000:0.0:1789127285.055425:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789421824 00000100:00100000:0.0:1789127285.055435:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789422336 00000100:00100000:0.0:1789127285.055437:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789422336 00000100:00100000:0.0:1789127285.055450:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789127285.055456:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789422080:12345-0@lo:400: 00000100:00100000:0.0:1789127285.055493:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789422080:12345-0@lo:400: Request processed in 36us (3732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127285.055499:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789127285.055527:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789127285.055534:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789422464:12345-0@lo:400: 00000100:00100000:0.0:1789127285.055563:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789422464:12345-0@lo:400: Request processed in 30us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127285.055569:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789127285.055581:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789127285.055587:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789421824:12345-0@lo:400: 00000100:00100000:0.0:1789127285.055611:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed103c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789421824:12345-0@lo:400: Request processed in 25us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127285.055623:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789127285.055634:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789127285.055640:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789422336:12345-0@lo:400: 00000100:00100000:0.0:1789127285.055667:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed11680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789422336:12345-0@lo:400: Request processed in 27us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127285.055672:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789127285.055687:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127285.055691:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789127285.055721:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934692922580 x1876035789422080/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127285.055735:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692922580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789422080:0@lo:400: 00010000:00080000:0.0:1789127285.057590:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934692920780 x1876035789421824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127285.057607:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789421824:0@lo:400: 00010000:00080000:0.0:1789127285.057620:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346aed11a40 x1876035789422336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127285.057629:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789422336:0@lo:400: 00000100:00100000:0.0:1789127285.057641:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789421952:0@lo:400: 00010000:00080000:0.0:1789127285.057651:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346aed121c0 x1876035789422464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127285.057659:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed121c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789422464:0@lo:400: 00000020:00000004:2.0:1789127285.380265:0:9016:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127285.380275:0:9016:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1789127285.687688:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127286.712917:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127287.739886:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127288.762306:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127289.143836:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127289.144230:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789422848:0@lo:41: 00000100:00100000:2.0:1789127289.144308:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127289.145013:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789422848 00000100:00100000:0.0:1789127289.145044:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789422848 00000100:00100000:0.0:1789127289.145130:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789127289.145142:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789422848:12345-0@lo:41: 00000004:00000024:0.0:1789127289.145188:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789127289.145281:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789422848:12345-0@lo:41: Request processed in 142us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127289.145289:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789127289.149660:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789422848:0@lo:41: 00000100:00100000:0.0:1789127289.655957:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127289.655993:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789422976:0@lo:41: 00000100:00100000:0.0:1789127289.656099:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127289.656244:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789422976 00000100:00100000:2.0:1789127289.656254:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789422976 00000100:00100000:2.0:1789127289.656316:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127289.656328:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586047840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789422976:12345-0@lo:41: 00000004:00000024:2.0:1789127289.656373:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789127289.656439:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586047840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789422976:12345-0@lo:41: Request processed in 113us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127289.656448:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789127289.656564:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789422976:0@lo:41: 00010000:00010000:2.0:1789127289.783857:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127290.167961:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345860452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789423104:0@lo:400: 00000100:00100000:0.0:1789127290.168057:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127290.168132:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789423616:0@lo:400: 00000100:00100000:0.0:1789127290.168159:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127290.168178:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345860443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789424128:0@lo:400: 00000100:00100000:0.0:1789127290.168200:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127290.168224:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789127290.168229:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345860461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789423232:0@lo:400: 00000100:00100000:0.0:1789127290.168251:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127290.168265:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789423744:0@lo:400: 00000100:00100000:0.0:1789127290.168282:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127290.168315:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789423104 00000100:00100000:0.0:1789127290.168324:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789423104 00000100:00100000:0.0:1789127290.168376:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789127290.168386:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934688ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3650:x1876035789423104:12345-0@lo:400: 00000100:00100000:0.0:1789127290.168445:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934688ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3650:x1876035789423104:12345-0@lo:400: Request processed in 58us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127290.168475:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789127290.168699:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586045a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789423360:0@lo:400: 00000100:00100000:1.0:1789127290.168735:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127290.168758:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586044780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789423872:0@lo:400: 00000100:00100000:1.0:1789127290.168805:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127290.168830:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789127290.168836:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345860470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789423488:0@lo:400: 00000100:00100000:1.0:1789127290.168858:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127290.168867:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586046d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789424000:0@lo:400: 00000100:00100000:1.0:1789127290.168893:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127290.168924:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789423360 00000100:00100000:1.0:1789127290.168928:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789423360 00000100:00100000:1.0:1789127290.168963:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789127290.168970:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789423360:12345-0@lo:400: 00000100:00100000:1.0:1789127290.169014:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789423360:12345-0@lo:400: Request processed in 45us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127290.169021:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789127290.169042:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789423232 00000100:00100000:1.0:1789127290.169046:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789423232 00000100:00100000:1.0:1789127290.169064:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789423744 00000100:00100000:1.0:1789127290.169067:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789423744 00000100:00100000:1.0:1789127290.169105:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789423872 00000100:00100000:1.0:1789127290.169109:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789423872 00000100:00100000:1.0:1789127290.169123:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789423488 00000100:00100000:1.0:1789127290.169125:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789423488 00000100:00100000:1.0:1789127290.169137:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789127290.169142:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692921a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789423232:12345-0@lo:400: 00000100:00100000:1.0:1789127290.169186:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692921a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789423232:12345-0@lo:400: Request processed in 43us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127290.169192:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789127290.169204:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789127290.169210:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692920780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789423744:12345-0@lo:400: 00000100:00100000:1.0:1789127290.169234:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692920780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789423744:12345-0@lo:400: Request processed in 25us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127290.169240:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789127290.169249:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789127290.169254:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789423872:12345-0@lo:400: 00000100:00100000:1.0:1789127290.169273:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789423872:12345-0@lo:400: Request processed in 19us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127290.169279:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789127290.169287:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789127290.169291:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789423488:12345-0@lo:400: 00000100:00100000:1.0:1789127290.169310:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789423488:12345-0@lo:400: Request processed in 19us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127290.169316:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789127290.169334:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127290.169338:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127290.169346:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789424256:0@lo:13: 00000100:00100000:1.0:1789127290.169371:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127290.169399:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789424256 00000100:00100000:1.0:1789127290.169403:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789424256 00000100:00100000:1.0:1789127290.169434:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127290.169441:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789424256:12345-0@lo:13: 00002000:00000024:1.0:1789127290.169482:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127290.169566:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789424256:12345-0@lo:13: Request processed in 125us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127290.169573:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789127290.169590:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789127290.169614:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b73a12c0 x1876035789424256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127290.169633:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789424256:0@lo:13: 00010000:00080000:1.0:1789127290.169663:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345860470c0 x1876035789423488/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127290.169673:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345860470c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789423488:0@lo:400: 00000100:00100000:1.0:1789127290.169685:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586045a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789423360:0@lo:400: 00010000:00080000:1.0:1789127290.169695:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934586044780 x1876035789423872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127290.169703:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586044780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789423872:0@lo:400: 00000100:00100000:1.0:1789127290.169764:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789424128 00000100:00100000:1.0:1789127290.169768:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789424128 00000100:00100000:1.0:1789127290.169792:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789424000 00000100:00100000:1.0:1789127290.169795:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789424000 00000100:00100000:1.0:1789127290.169818:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127290.169825:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586047c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789424128:12345-0@lo:400: 00000100:00100000:1.0:1789127290.169858:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586047c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789424128:12345-0@lo:400: Request processed in 34us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127290.169865:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127290.169876:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127290.169889:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789424000:12345-0@lo:400: 00000100:00100000:1.0:1789127290.169922:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789424000:12345-0@lo:400: Request processed in 35us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127290.169929:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789127290.169961:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789127290.169977:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934586046d00 x1876035789424000/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127290.169987:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586046d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789424000:0@lo:400: 00010000:00080000:1.0:1789127290.170027:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345860461c0 x1876035789423232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127290.170037:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345860461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789423232:0@lo:400: 00010000:00080000:1.0:1789127290.170047:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934586047480 x1876035789423744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127290.170055:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789423744:0@lo:400: 00000100:00100000:1.0:1789127290.170064:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345860452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789423104:0@lo:400: 00010000:00080000:1.0:1789127290.170083:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345860443c0 x1876035789424128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127290.170091:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345860443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789424128:0@lo:400: 00000100:00100000:0.0:1789127290.170452:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789423616 00000100:00100000:0.0:1789127290.170460:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789423616 00000100:00100000:1.0:1789127290.170824:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127290.170838:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789424384:0@lo:13: 00000100:00100000:1.0:1789127290.170880:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127290.170964:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789127290.170972:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789423616:12345-0@lo:400: 00000100:00100000:1.0:1789127290.171014:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789423616:12345-0@lo:400: Request processed in 43us (2854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127290.171030:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789127290.171062:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789423616:0@lo:400: 00000100:00100000:0.0:1789127290.174428:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789424384 00000100:00100000:0.0:1789127290.174452:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789424384 00000100:00100000:0.0:1789127290.174558:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789127290.174571:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789424384:12345-0@lo:13: 00002000:00000024:0.0:1789127290.174605:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127290.174721:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789424384:12345-0@lo:13: Request processed in 153us (3840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127290.174730:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789127290.174786:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346aed10b40 x1876035789424384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127290.174810:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789424384:0@lo:13: 00010000:00010000:0.0:1789127290.808546:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127291.833330:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127292.859075:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127293.879899:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127294.264913:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789424512:0@lo:41: 00000100:00100000:1.0:1789127294.264982:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127294.265090:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789424512 00000100:00100000:3.0:1789127294.265097:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789424512 00000100:00100000:3.0:1789127294.265147:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789127294.265171:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789424512:12345-0@lo:41: 00000004:00000024:3.0:1789127294.265203:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1789127294.270518:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789424512:12345-0@lo:41: Request processed in 5347us (5519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127294.270542:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789127294.274716:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789424512:0@lo:41: 00000100:00100000:1.0:1789127294.781458:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789424640:0@lo:41: 00000100:00100000:1.0:1789127294.781562:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127294.781871:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789424640 00000100:00100000:2.0:1789127294.781879:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789424640 00000100:00100000:2.0:1789127294.781931:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789127294.781940:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345860443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789424640:12345-0@lo:41: 00000004:00000024:2.0:1789127294.781972:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789127294.782029:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345860443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789424640:12345-0@lo:41: Request processed in 91us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127294.782036:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789127294.782148:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789424640:0@lo:41: 00010000:00010000:2.0:1789127294.910795:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127295.287735:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127295.287770:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789425152:0@lo:400: 00000100:00100000:0.0:1789127295.287814:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789425280:0@lo:400: 00000100:00100000:0.0:1789127295.287874:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127295.287927:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127295.287941:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789425792:0@lo:400: 00000100:00100000:1.0:1789127295.287952:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789424768:0@lo:400: 00000100:00100000:0.0:1789127295.287971:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127295.288260:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789425152 00000100:00100000:2.0:1789127295.288267:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789425152 00000100:00100000:2.0:1789127295.288317:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789127295.288326:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789425152:12345-0@lo:400: 00000100:00100000:0.0:1789127295.288460:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127295.288467:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7395a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789425664:0@lo:400: 00000100:00100000:0.0:1789127295.288493:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127295.289257:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789425280 00000100:00100000:3.0:1789127295.289263:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789425280 00000100:00100000:3.0:1789127295.289309:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789425664 00000100:00100000:3.0:1789127295.289313:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789425664 00000100:00100000:3.0:1789127295.289341:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127295.289348:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7396940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789425280:12345-0@lo:400: 00000100:00100000:3.0:1789127295.289397:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7396940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789425280:12345-0@lo:400: Request processed in 50us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127295.289404:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127295.289420:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789127295.289427:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7397840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789425664:12345-0@lo:400: 00000100:00100000:3.0:1789127295.289455:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7397840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789425664:12345-0@lo:400: Request processed in 30us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127295.289469:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1789127295.289504:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b7395a40 x1876035789425664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127295.289545:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7395a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789425664:0@lo:400: 00010000:00080000:3.0:1789127295.289559:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b7394b40 x1876035789425280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127295.289568:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789425280:0@lo:400: 00000100:00100000:0.0:1789127295.290716:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789425792 00000100:00100000:0.0:1789127295.290726:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789425792 00000100:00100000:0.0:1789127295.290783:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127295.290793:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7397c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789425792:12345-0@lo:400: 00000100:00100000:0.0:1789127295.290866:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7397c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789425792:12345-0@lo:400: Request processed in 76us (2896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127295.290874:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127295.291250:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789425024:0@lo:400: 00000100:00100000:3.0:1789127295.291291:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127295.291325:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789425536:0@lo:400: 00000100:00100000:3.0:1789127295.291356:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127295.291376:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789426048:0@lo:13: 00000100:00100000:3.0:1789127295.291401:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127295.291434:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789127295.291441:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345860452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789424896:0@lo:13: 00000100:00100000:3.0:1789127295.291464:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127295.291482:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789425408:0@lo:400: 00000100:00100000:3.0:1789127295.291504:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127295.291542:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789425920:0@lo:400: 00000100:00100000:3.0:1789127295.291565:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127295.291606:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789426048 00000100:00100000:3.0:1789127295.291611:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789426048 00000100:00100000:3.0:1789127295.291634:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789424896 00000100:00100000:3.0:1789127295.291638:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789424896 00000100:00100000:3.0:1789127295.291663:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127295.291669:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789426048:12345-0@lo:13: 00002000:00000024:3.0:1789127295.291693:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127295.291808:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789426048:12345-0@lo:13: Request processed in 138us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127295.291815:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127295.291831:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127295.291838:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed12d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789424896:12345-0@lo:13: 00002000:00000024:3.0:1789127295.291848:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127295.291873:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed12d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789424896:12345-0@lo:13: Request processed in 36us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127295.291879:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127295.291899:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789425408 00000100:00100000:3.0:1789127295.291903:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789425408 00000100:00100000:3.0:1789127295.291926:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789127295.291932:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789425408:12345-0@lo:400: 00000100:00100000:3.0:1789127295.291964:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789425408:12345-0@lo:400: Request processed in 32us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127295.291970:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789127295.291991:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789425024 00000100:00100000:3.0:1789127295.291995:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789425024 00000100:00100000:3.0:1789127295.292018:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789425536 00000100:00100000:3.0:1789127295.292021:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789425536 00000100:00100000:3.0:1789127295.292034:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789127295.292039:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789425024:12345-0@lo:400: 00000100:00100000:0.0:1789127295.292231:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789127295.292240:0:6523:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789127295.292342:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127295.292349:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789425536:12345-0@lo:400: 00000100:00100000:0.0:1789127295.292384:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789425536:12345-0@lo:400: Request processed in 36us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127295.292391:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789127295.292488:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127295.292534:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789425920 00000100:00100000:1.0:1789127295.292539:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789425920 00000100:00100000:1.0:1789127295.292576:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127295.292585:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789425920:12345-0@lo:400: 00000100:00100000:1.0:1789127295.292622:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789425920:12345-0@lo:400: Request processed in 39us (1055us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127295.292628:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789127295.292648:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127295.292654:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789127295.292657:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127295.292662:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789425024:12345-0@lo:400: Request processed in 619us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127295.292671:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789127295.292699:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789424768 00000100:00100000:3.0:1789127295.292703:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789424768 00000100:00100000:2.0:1789127295.292846:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789425152:12345-0@lo:400: Request processed in 4519us (4917us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127295.292854:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789127295.292922:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789127295.292931:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934688ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3650:x1876035789424768:12345-0@lo:400: 00000100:00100000:3.0:1789127295.292962:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934688ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3650:x1876035789424768:12345-0@lo:400: Request processed in 33us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127295.292968:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:3.0:1789127295.293018:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345860452c0 x1876035789424896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127295.293039:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345860452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789424896:0@lo:13: 00000100:00100000:3.0:1789127295.293236:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789425408:0@lo:400: 00010000:00080000:3.0:1789127295.293247:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b73952c0 x1876035789425920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127295.293256:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789425920:0@lo:400: 00010000:00080000:3.0:1789127295.293265:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934692b4da40 x1876035789425024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127295.293274:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789425024:0@lo:400: 00000100:00100000:1.0:1789127295.293286:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789425152:0@lo:400: 00010000:00080000:3.0:1789127295.293291:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b73970c0 x1876035789425536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127295.293302:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789425536:0@lo:400: 00000100:00100000:1.0:1789127295.293304:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789424768:0@lo:400: 00010000:00080000:3.0:1789127295.293320:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346aed10b40 x1876035789426048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127295.293335:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789426048:0@lo:13: 00010000:00080000:3.0:1789127295.293385:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b73961c0 x1876035789425792/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127295.293401:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789425792:0@lo:400: 00010000:00010000:2.0:1789127295.928246:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789127296.374727:0:9517:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789127296.374731:0:9517:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789127296.374732:0:9517:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789127296.374862:0:9517:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff934586ebc000 00000020:01000004:3.0:1789127296.374878:0:9517:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789127296.374892:0:9517:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789127296.374906:0:9517:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9346aec64ed8) 00000020:00000080:3.0:1789127296.374924:0:9517:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789127296.427533:0:9517:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789127296.429133:0:9517:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1789127296.478986:0:9517:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789127296.483402:0:9517:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789127296.483419:0:9517:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789127296.483430:0:9517:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd718aadfd785d3e5 00000020:01000004:2.0:1789127296.483437:0:9517:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789127296.483459:0:9517:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789127296.483462:0:9517:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789127296.483468:0:9517:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789127296.483499:0:9517:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789127296.483503:0:9517:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789127296.524937:0:9517:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789127296.524976:0:9517:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.148@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789127296.524981:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789127296.524982:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789127296.524984:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127296.524985:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127296.524986:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127296.524987:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127296.524989:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127296.524990:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789127296.524992:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789127296.524993:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127296.524995:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789127296.524998:0:9517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789127296.525000:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789127296.525002:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789127296.525003:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127296.525004:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127296.525005:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127296.525006:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127296.525007:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127296.525008:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789127296.525009:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789127296.525010:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127296.525016:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789127296.525061:0:9517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789127296.525081:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed10000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789426176:0@lo:253: 00000100:00100000:3.0:1789127296.525161:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.525209:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127296.526636:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789426176 00000100:00100000:0.0:1789127296.526647:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789426176 00000100:00100000:0.0:1789127296.526706:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789127296.526716:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:9517:x1876035789426176:12345-0@lo:253: 20000000:01000000:0.0:1789127296.526767:0:6517:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789127296.526771:0:6517:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789127296.526777:0:6517:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789127296.526780:0:6517:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789127296.527644:0:6517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127296.527803:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:0.0:1789127296.527819:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789127296.527836:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:0.0:1789127296.527842:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789127296.527853:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:0.0:1789127296.527867:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:0.0:1789127296.527958:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:0.0:1789127296.527973:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.148@tcp 20000000:01000000:0.0:1789127296.527975:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:0.0:1789127296.527989:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:0.0:1789127296.528002:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789127296.528018:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:0.0:1789127296.528024:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:0.0:1789127296.528118:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:0.0:1789127296.528129:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789127296.528148:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:0.0:1789127296.528164:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:0.0:1789127296.528238:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:0.0:1789127296.528248:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.148@tcp 20000000:01000000:0.0:1789127296.528250:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:0.0:1789127296.528262:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:0.0:1789127296.528266:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789127296.528276:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:0.0:1789127296.528281:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:0.0:1789127296.528291:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:0.0:1789127296.528295:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789127296.528305:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:0.0:1789127296.528317:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:0.0:1789127296.529295:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:0.0:1789127296.529314:0:6517:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.206.148@tcp 20000000:01000000:0.0:1789127296.529316:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.206.148@tcp (null) (null) (null) 00000040:00080000:0.0:1789127296.529333:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:0.0:1789127296.529339:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789127296.529356:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:0.0:1789127296.529362:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.148@tcp (null) (null) 00000040:00080000:0.0:1789127296.529375:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:0.0:1789127296.529382:0:6517:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789127296.529394:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:0.0:1789127296.529408:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:0.0:1789127296.529422:0:6517:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789127296.529435:0:6517:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789127296.529439:0:6517:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789127296.529483:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789127296.529486:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789127296.534774:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1789127296.539813:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1789127296.539849:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1789127296.539867:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1789127296.539880:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789127296.539882:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789127296.546953:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1789127296.547004:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1789127296.547037:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1789127296.554828:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1789127296.554864:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1789127296.554878:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1789127296.554895:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789127296.554898:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789127296.555849:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:0.0:1789127296.555887:0:9525:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:0.0:1789127296.555904:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789127296.556755:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789127296.556782:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789127296.556797:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1789127296.556810:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789127296.556812:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789127296.557177:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 27 1->4: lustre sys.timeout 20000000:01000000:2.0:1789127296.557197:0:9526:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 27 2->4: lustre sys.timeout 00000040:00080000:2.0:1789127296.557211:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1789127296.557385:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1789127296.557404:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1789127296.557419:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1789127296.557429:0:6517:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789127296.557432:0:6517:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789127296.558137:0:9527:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1789127296.558170:0:9527:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1789127296.558183:0:9527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1789127296.558341:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1789127296.558361:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:2.0:1789127296.558375:0:6517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 10000000:01000000:2.0:1789127296.558394:0:6517:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789127296.558415:0:6517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.558433:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346813c8400/0xd718aadfd785d2e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d2db expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.558442:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d30c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d305 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.558456:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928ff000/0xd718aadfd785d34b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d344 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.558464:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346c214d800/0xd718aadfd785d367 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d360 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.558470:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d391 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d383 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.558476:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346813c8000/0xd718aadfd785d3ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d3a6 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.558483:0:6517:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346813c9c00/0xd718aadfd785d3d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d3c9 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.558490:0:6517:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.558566:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346813c9c00/0xd718aadfd785d3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d3c9 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.558700:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346813c9c00/0xd718aadfd785d3d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d3c9 expref: 21 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127296.558717:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e4b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789426304:0@lo:104: 00000100:00100000:2.0:1789127296.558778:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127296.558824:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346813c8000/0xd718aadfd785d3ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d3a6 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.558831:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346813c8000/0xd718aadfd785d3ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d3a6 expref: 21 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127296.558847:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e70c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789426432:0@lo:104: 00000100:00100000:2.0:1789127296.558867:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127296.558931:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d383 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.558940:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d383 expref: 21 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127296.558948:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e61c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789426560:0@lo:104: 00000100:00100000:2.0:1789127296.558966:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127296.559181:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346c214d800/0xd718aadfd785d367 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d360 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.559189:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346c214d800/0xd718aadfd785d367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d360 expref: 21 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127296.559197:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e6940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789426688:0@lo:104: 00000100:00100000:2.0:1789127296.559218:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127296.559286:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789426304 00000100:00100000:0.0:1789127296.559293:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789426304 00000100:00100000:0.0:1789127296.559329:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789426432 00000100:00100000:0.0:1789127296.559332:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789426432 00000100:00100000:0.0:1789127296.559341:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789426560 00000100:00100000:0.0:1789127296.559343:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789426560 00000100:00100000:0.0:1789127296.559356:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127296.559364:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:6517:x1876035789426304:12345-0@lo:104: 00010000:00010000:0.0:1789127296.559377:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d3d0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.559474:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127296.559480:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:6517:x1876035789426304:12345-0@lo:104: Request processed in 117us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127296.559487:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127296.559503:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127296.559534:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:6517:x1876035789426432:12345-0@lo:104: 00010000:00010000:0.0:1789127296.559542:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d3ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.559748:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928ff000/0xd718aadfd785d34b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d344 expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.559758:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928ff000/0xd718aadfd785d34b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d344 expref: 21 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127296.559767:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e7840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789426816:0@lo:104: 00000100:00100000:2.0:1789127296.559790:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127296.559808:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d30c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d305 expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.559827:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d30c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d305 expref: 21 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127296.559835:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e4780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789426944:0@lo:104: 00000100:00100000:2.0:1789127296.559859:0:6517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127296.559874:0:6517:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346813c8400/0xd718aadfd785d2e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d2db expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.559881:0:6517:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346813c8400/0xd718aadfd785d2e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d2db expref: 21 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127296.559888:0:6517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789427072:0@lo:104: 00000100:00100000:2.0:1789127296.559907:0:6517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127296.559927:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e4b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789426304:0@lo:104: 00000100:00100000:2.0:1789127296.559936:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e70c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789426432:0@lo:104: 00000100:00100000:1.0:1789127296.560003:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789426688 00000100:00100000:1.0:1789127296.560008:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789426688 00000100:00100000:1.0:1789127296.560035:0:6506:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789127296.560067:0:6506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127296.560076:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789127296.560081:0:6506:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1789127296.560174:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789426816 00000100:00100000:1.0:1789127296.560178:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789426816 00000100:00100000:1.0:1789127296.560193:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789127296.560198:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789426944 00000100:00100000:1.0:1789127296.560200:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789426944 00000100:00100000:1.0:1789127296.560207:0:6506:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789127296.560211:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789427072 00000100:00100000:1.0:1789127296.560213:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789427072 00000100:00100000:1.0:1789127296.560280:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789127296.560294:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+8:6517:x1876035789426560:12345-0@lo:104: 00010000:00010000:1.0:1789127296.560304:0:9528:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d391 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127296.560399:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e61c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789426560:0@lo:104: 00010000:00010000:3.0:1789127296.560538:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789127296.560546:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d3d0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560554:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1c00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:3.0:1789127296.560558:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d3d0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560566:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d3d0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127296.560581:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d3d0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127296.560588:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127296.560620:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d3d0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560626:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127296.560645:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d3d0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560652:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d3c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d3d0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560665:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127296.560675:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d3ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560681:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0400 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:3.0:1789127296.560685:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d3ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560692:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d3ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127296.560699:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d3ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127296.560704:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127296.560719:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d3ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560725:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127296.560730:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d3ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560737:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a0400/0xd718aadfd785d3a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d3ad expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560745:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127296.560748:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d391 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560753:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214ce00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:3.0:1789127296.560756:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d391 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560772:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d391 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127296.560779:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d391 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127296.560784:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127296.560801:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d391 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560806:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127296.560819:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d391 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560826:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d383 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d391 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.560836:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127296.560838:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127296.560840:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127296.560852:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789427200:0@lo:103: 00000100:00100000:3.0:1789127296.560900:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.560924:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127296.560930:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789427328:0@lo:103: 00000100:00100000:3.0:1789127296.560950:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.560973:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789427456:0@lo:103: 00000100:00100000:3.0:1789127296.560992:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.561019:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789427200 00000100:00100000:3.0:1789127296.561028:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789427200 00010000:00010000:3.0:1789127296.561063:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346813c9c00/0xd718aadfd785d3d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d3c9 expref: 22 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127296.561080:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789427328 00000100:00100000:3.0:1789127296.561082:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789427328 00010000:00010000:3.0:1789127296.561091:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346813c8000/0xd718aadfd785d3ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d3a6 expref: 23 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127296.561099:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789427456 00000100:00100000:3.0:1789127296.561101:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789427456 00010000:00010000:3.0:1789127296.561109:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d383 expref: 24 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127296.561120:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789127296.561125:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789427200:12345-0@lo:103: 00010000:00010000:3.0:1789127296.561135:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127296.561139:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346813c9c00/0xd718aadfd785d3d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d3c9 expref: 24 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.561150:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346813c9c00/0xd718aadfd785d3d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d3c9 expref: 24 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.561163:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346813c9c00/0xd718aadfd785d3d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d3c9 expref: 24 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.561176:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127296.561201:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:3650:x1876035789427200:12345-0@lo:103: Request processed in 76us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.561208:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789127296.561222:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127296.561233:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:3650:x1876035789427328:12345-0@lo:103: 00010000:00010000:3.0:1789127296.561240:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127296.561244:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346813c8000/0xd718aadfd785d3ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d3a6 expref: 22 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.561253:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346813c8000/0xd718aadfd785d3ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d3a6 expref: 22 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.561262:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346813c8000/0xd718aadfd785d3ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d3a6 expref: 22 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.561271:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127296.561291:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3650:x1876035789427328:12345-0@lo:103: Request processed in 59us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.561296:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127296.561308:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789127296.561313:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ce940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:3652:x1876035789427456:12345-0@lo:103: 00010000:00010000:3.0:1789127296.561330:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127296.561335:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d391 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d383 expref: 20 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.561343:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d391 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d383 expref: 20 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.561352:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d391 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d383 expref: 20 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.561360:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127296.561384:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ce940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:3652:x1876035789427456:12345-0@lo:103: Request processed in 71us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.561399:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789127296.561426:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789427456:0@lo:103: 00000100:00100000:3.0:1789127296.561449:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789427328:0@lo:103: 00000100:00100000:3.0:1789127296.561455:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789427200:0@lo:103: 00010000:00010000:0.0:1789127296.561837:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1789127296.561845:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e5a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+8:6517:x1876035789426432:12345-0@lo:104: Request processed in 2335us (2975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127296.561852:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127296.561869:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127296.561876:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+7:6517:x1876035789426688:12345-0@lo:104: 00010000:00010000:0.0:1789127296.561886:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d367 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.561941:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127296.561947:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+7:6517:x1876035789426688:12345-0@lo:104: Request processed in 73us (2729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127296.561952:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127296.561967:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127296.561974:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:6517:x1876035789426816:12345-0@lo:104: 00010000:00010000:0.0:1789127296.561981:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d34b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.562011:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789127296.562016:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:6517:x1876035789426816:12345-0@lo:104: Request processed in 44us (2226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127296.562022:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127296.562034:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127296.562056:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b731cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:6517:x1876035789426944:12345-0@lo:104: 00010000:00010000:0.0:1789127296.562063:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d30c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.562109:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789127296.562114:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b731cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:6517:x1876035789426944:12345-0@lo:104: Request processed in 60us (2255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127296.562120:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127296.562133:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127296.562139:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345860461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:6517:x1876035789427072:12345-0@lo:104: 00010000:00010000:0.0:1789127296.562147:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d2e2 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.562172:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789127296.562177:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345860461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:6517:x1876035789427072:12345-0@lo:104: Request processed in 38us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127296.562182:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1789127296.562252:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789127296.562258:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d367 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562264:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214c600 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:3.0:1789127296.562267:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d367 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562274:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d367 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127296.562280:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d367 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127296.562286:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127296.562310:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d367 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562316:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127296.562329:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d367 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562336:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346c214c600/0xd718aadfd785d360 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d367 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562358:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789127296.562361:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d34b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562366:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fea00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:3.0:1789127296.562369:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d34b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562376:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d34b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127296.562381:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d34b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127296.562386:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127296.562400:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d34b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562406:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127296.562416:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d34b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562423:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928fea00/0xd718aadfd785d344 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d34b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562433:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127296.562435:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d30c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562460:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214dc00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:3.0:1789127296.562463:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d30c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562468:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d30c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127296.562473:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d30c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127296.562477:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127296.562491:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d30c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562497:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127296.562502:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d30c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562535:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346c214dc00/0xd718aadfd785d305 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d30c expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562544:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127296.562547:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d2e2 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562552:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0a00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:3.0:1789127296.562555:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d2e2 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562582:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d2e2 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127296.562588:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d2e2 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127296.562593:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127296.562606:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d2e2 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562611:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127296.562616:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d2e2 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562621:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d2db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d2e2 expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562633:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127296.562635:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127296.562636:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127296.562649:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789427584:0@lo:103: 00000100:00100000:3.0:1789127296.562684:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.562714:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127296.562719:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789427968:0@lo:103: 00000100:00100000:3.0:1789127296.562740:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.562761:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789427840:0@lo:103: 00000100:00100000:3.0:1789127296.562780:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.562795:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127296.562808:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789427712:0@lo:103: 00000100:00100000:3.0:1789127296.562829:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.562853:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789427584 00000100:00100000:3.0:1789127296.562858:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789427584 00010000:00010000:3.0:1789127296.562877:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346c214d800/0xd718aadfd785d367 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d360 expref: 19 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127296.562892:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789427968 00000100:00100000:3.0:1789127296.562895:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789427968 00010000:00010000:3.0:1789127296.562905:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346813c8400/0xd718aadfd785d2e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d2db expref: 20 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127296.562915:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789427840 00000100:00100000:3.0:1789127296.562918:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789427840 00010000:00010000:3.0:1789127296.562927:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d30c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d305 expref: 21 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127296.562937:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789427712 00000100:00100000:3.0:1789127296.562939:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789427712 00010000:00010000:3.0:1789127296.562948:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928ff000/0xd718aadfd785d34b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d344 expref: 22 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127296.562959:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127296.562965:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9def450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:3653:x1876035789427584:12345-0@lo:103: 00010000:00010000:3.0:1789127296.562974:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127296.562979:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346c214d800/0xd718aadfd785d367 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d360 expref: 22 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.562988:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346c214d800/0xd718aadfd785d367 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d360 expref: 22 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563001:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127296.563032:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9def450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:3653:x1876035789427584:12345-0@lo:103: Request processed in 66us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.563038:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127296.563082:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127296.563087:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3653:x1876035789427968:12345-0@lo:103: 00010000:00010000:3.0:1789127296.563093:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127296.563097:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346813c8400/0xd718aadfd785d2e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d2db expref: 21 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563105:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346813c8400/0xd718aadfd785d2e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d2db expref: 21 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563114:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127296.563132:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3653:x1876035789427968:12345-0@lo:103: Request processed in 45us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.563138:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127296.563149:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789127296.563154:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:3651:x1876035789427840:12345-0@lo:103: 00010000:00010000:3.0:1789127296.563162:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127296.563166:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d30c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d305 expref: 20 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563174:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d30c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d305 expref: 20 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563181:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127296.563207:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:3651:x1876035789427840:12345-0@lo:103: Request processed in 52us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.563212:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789127296.563233:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789127296.563238:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:3651:x1876035789427712:12345-0@lo:103: 00010000:00010000:3.0:1789127296.563245:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127296.563249:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928ff000/0xd718aadfd785d34b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d344 expref: 19 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563256:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928ff000/0xd718aadfd785d34b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d344 expref: 19 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563267:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563275:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563289:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563296:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563301:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563308:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563313:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fec00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127296.563316:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563324:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563340:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563350:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127296.563374:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:3651:x1876035789427712:12345-0@lo:103: Request processed in 136us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.563381:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789127296.563427:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789427712:0@lo:103: 00000100:00100000:3.0:1789127296.563437:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789427840:0@lo:103: 00000100:00100000:3.0:1789127296.563461:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789427968:0@lo:103: 00000100:00100000:3.0:1789127296.563468:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789427584:0@lo:103: 00010000:00010000:3.0:1789127296.563490:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346c214d800/0xd718aadfd785d367 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d360 expref: 18 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127296.563501:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e6940 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789426688:0@lo:104: 00010000:00010000:3.0:1789127296.563533:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928ff000/0xd718aadfd785d34b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d344 expref: 17 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127296.563541:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e7840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789426816:0@lo:104: 00010000:00010000:3.0:1789127296.563551:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d30c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d305 expref: 16 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127296.563558:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e4780 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789426944:0@lo:104: 00010000:00010000:3.0:1789127296.563567:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346813c8400/0xd718aadfd785d2e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d2db expref: 15 pid: 6514 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127296.563587:0:6517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e7480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6517:1876035789427072:0@lo:104: 00010000:00010000:3.0:1789127296.563614:0:6517:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563623:0:6517:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563629:0:6517:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.563635:0:6517:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928fec00/0xd718aadfd785d3ec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789127296.563646:0:6517:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1789127296.563902:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127296.563909:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127296.565340:0:9528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1789127296.565353:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e52c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6517:x1876035789426560:12345-0@lo:104: Request processed in 5057us (6382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127296.565366:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1789127296.565462:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127296.566395:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:9517:x1876035789426176:12345-0@lo:253: Request processed in 39677us (41229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.566407:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789127296.566500:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed10000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789426176:0@lo:253: 10000000:01000000:1.0:1789127296.566544:0:9517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789127296.566548:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789127296.566550:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789127296.566551:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127296.566552:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789127296.566554:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127296.566555:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127296.566556:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127296.566558:0:9517:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789127296.566559:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127296.566561:0:9517:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789127296.566592:0:9517:0:(tgt_mount.c:101:server_register_mount()) register mount ffff934586ebc000 from lustre-OST0001 10000000:01000000:1.0:1789127296.566622:0:9517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789127296.566625:0:9517:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789127296.566633:0:9517:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9346b18f3490 local copy 10000000:01000000:1.0:1789127296.566637:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789127296.566671:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.566681:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.566690:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127296.566719:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586046d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789428096:0@lo:101: 00000100:00100000:1.0:1789127296.566752:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127296.566774:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aed093c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127296.566934:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789428096 00000100:00100000:3.0:1789127296.566941:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789428096 00000100:00100000:3.0:1789127296.566990:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789127296.566998:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:9517:x1876035789428096:12345-0@lo:101: 00010000:00010000:3.0:1789127296.567012:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127296.567025:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93469a7a1800/0xd718aadfd785d3fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d3f3 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.567124:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93469a7a1800/0xd718aadfd785d3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d3f3 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.567147:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93469a7a1800/0xd718aadfd785d3fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d3f3 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.567157:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a1800, rc 0) 00000100:00100000:3.0:1789127296.567274:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:9517:x1876035789428096:12345-0@lo:101: Request processed in 276us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.567281:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789127296.567784:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586046d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789428096:0@lo:101: 00010000:00010000:2.0:1789127296.567801:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd718aadfd785d3fa expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.567809:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd718aadfd785d3fa expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127296.567912:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789428224:0@lo:501: 00000100:00100000:2.0:1789127296.567957:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127296.567990:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127296.568058:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789428224 00000100:00100000:3.0:1789127296.568064:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789428224 00000100:00100000:3.0:1789127296.568101:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789127296.568109:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:9517:x1876035789428224:12345-0@lo:501: 00000100:00100000:3.0:1789127296.568175:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:9517:x1876035789428224:12345-0@lo:501: Request processed in 67us (217us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789127296.568182:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789127296.568334:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789428224:0@lo:501: 10000000:01000000:2.0:1789127296.568348:0:9517:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789127296.568364:0:9517:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789127296.568369:0:9517:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd718aadfd785d3fa expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.568377:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd718aadfd785d3fa expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.568383:0:9517:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd718aadfd785d3fa expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.568409:0:9517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789127296.568444:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff934586ebc000 10000000:01000000:2.0:1789127296.568449:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789127296.568454:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789127296.568456:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789127296.568460:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789127296.568463:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789127296.568480:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.568488:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.568495:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127296.568553:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789428352:0@lo:101: 00010000:00010000:0.0:1789127296.568686:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127296.568693:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd718aadfd785d3fa expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.568700:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214de00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127296.568704:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd718aadfd785d3fa expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.568712:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd718aadfd785d3fa expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127296.568719:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd718aadfd785d3fa expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127296.568725:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127296.568751:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd718aadfd785d3fa expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.568757:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127296.568779:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd718aadfd785d3fa expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.568786:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d3f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd718aadfd785d3fa expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.568798:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127296.568799:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127296.568801:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127296.568892:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127296.568904:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7395680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789428480:0@lo:103: 00000100:00100000:1.0:1789127296.570293:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.570386:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789428480 00000100:00100000:3.0:1789127296.570393:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789428480 00000100:00100000:3.0:1789127296.570450:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127296.570459:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586044780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:3652:x1876035789428480:12345-0@lo:103: 00010000:00010000:3.0:1789127296.570471:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127296.570486:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93469a7a1800/0xd718aadfd785d3fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d3f3 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.570500:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127296.570565:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586044780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:3652:x1876035789428480:12345-0@lo:103: Request processed in 107us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.570582:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127296.570762:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7395680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789428480:0@lo:103: 00000100:00100000:2.0:1789127296.571164:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127296.571198:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127296.571247:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789428352 00000100:00100000:3.0:1789127296.571263:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789428352 00000100:00100000:3.0:1789127296.571299:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789127296.571307:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+14:9517:x1876035789428352:12345-0@lo:101: 00010000:00010000:3.0:1789127296.571319:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127296.571334:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d408 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d401 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.571352:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d401 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.571362:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d401 expref: 15 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.571369:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a0800, rc 0) 00000100:00100000:3.0:1789127296.571486:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:9517:x1876035789428352:12345-0@lo:101: Request processed in 179us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.571493:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789127296.574051:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789428352:0@lo:101: 00010000:00010000:1.0:1789127296.574082:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d408 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.574094:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d408 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127296.574342:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789428608:0@lo:501: 00000100:00100000:0.0:1789127296.574410:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127296.574453:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b54143c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127296.574538:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789428608 00000100:00100000:1.0:1789127296.574544:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789428608 00000100:00100000:1.0:1789127296.574707:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789127296.574716:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:9517:x1876035789428608:12345-0@lo:501: 00000100:00100000:1.0:1789127296.574876:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:9517:x1876035789428608:12345-0@lo:501: Request processed in 161us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127296.574884:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789127296.577234:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789428608:0@lo:501: 00000100:00100000:0.0:1789127296.577305:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789428736:0@lo:503: 00000100:00100000:0.0:1789127296.577378:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127296.577421:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b54143c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127296.577558:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789428736 00000100:00100000:3.0:1789127296.577564:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789428736 00000100:00100000:3.0:1789127296.577624:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789127296.577638:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:9517:x1876035789428736:12345-0@lo:503: 00000100:00100000:3.0:1789127296.577745:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:9517:x1876035789428736:12345-0@lo:503: Request processed in 108us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.577753:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789127296.577933:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789428736:0@lo:503: 00000040:00080000:2.0:1789127296.578207:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127296.578274:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789428864:0@lo:502: 00000100:00100000:2.0:1789127296.578316:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127296.578343:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127296.578360:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789428864 00000100:00100000:2.0:1789127296.578364:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789428864 00000100:00100000:2.0:1789127296.578391:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789127296.578398:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:9517:x1876035789428864:12345-0@lo:502: 00000100:00100000:2.0:1789127296.578482:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:9517:x1876035789428864:12345-0@lo:502: Request processed in 84us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127296.578489:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789127296.578563:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789428864:0@lo:502: 00000040:00080000:2.0:1789127296.578905:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789127296.578932:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1789127296.578946:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1789127296.578962:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789127296.578976:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789127296.578991:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789127296.579012:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789428992:0@lo:502: 00000100:00100000:2.0:1789127296.579115:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127296.579134:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127296.579158:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789428992 00000100:00100000:2.0:1789127296.579163:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789428992 00000100:00100000:2.0:1789127296.579186:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789127296.579193:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:9517:x1876035789428992:12345-0@lo:502: 00000100:00100000:2.0:1789127296.579265:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:9517:x1876035789428992:12345-0@lo:502: Request processed in 71us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127296.579272:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789127296.579314:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789428992:0@lo:502: 00000040:00080000:2.0:1789127296.579350:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789127296.579359:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1789127296.581292:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789127296.581304:0:9529:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789127296.581310:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127296.581312:0:9529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789127296.581318:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127296.581344:0:9529:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9346aec63490) 00000020:00000080:3.0:1789127296.581368:0:9529:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789127296.581375:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789127296.581450:0:9529:0:(tgt_mount.c:153:server_get_mount()) get mount ffff934586ebc000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789127296.581458:0:9529:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789127296.581465:0:9529:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd718aadfd785d416 00010000:00010000:3.0:1789127296.600340:0:9529:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1789127296.600662:0:9529:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789127296.605468:0:9529:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789127296.606469:0:9529:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789127296.612272:0:9529:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1789127296.612452:0:9529:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1789127296.619772:0:9529:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789127296.621796:0:9529:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789127296.621809:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127296.621816:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127296.621818:0:9529:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789127296.621823:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127296.621827:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127296.621829:0:9529:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789127296.621832:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789127296.621834:0:9529:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789127296.621851:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127296.621854:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127296.621856:0:9529:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789127296.621859:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789127296.622107:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789127296.622137:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789127296.622158:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d408 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.622170:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d408 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127296.622179:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934586ebc000 from 1 10000000:01000000:3.0:1789127296.622182:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127296.622217:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.622225:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.622236:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127296.622260:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789429120:0@lo:101: 00000100:00100000:3.0:1789127296.622323:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.622376:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72d8840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127296.622533:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789429120 00000100:00100000:1.0:1789127296.622541:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789429120 00000100:00100000:1.0:1789127296.622597:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789127296.622607:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:9517:x1876035789429120:12345-0@lo:101: 00010000:00010000:1.0:1789127296.622627:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127296.622639:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346c214d200/0xd718aadfd785d424 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d41d expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.622660:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346c214d200/0xd718aadfd785d424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d41d expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.622670:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346c214d200/0xd718aadfd785d424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d41d expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.622679:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214d200, rc 0) 00000100:00100000:1.0:1789127296.622713:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:9517:x1876035789429120:12345-0@lo:101: Request processed in 109us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127296.622720:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789127296.622860:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789429120:0@lo:101: 00010000:00010000:3.0:1789127296.622874:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d424 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127296.622882:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d424 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127296.622959:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789429248:0@lo:501: 00000100:00100000:3.0:1789127296.622986:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.623013:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72d8840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127296.623198:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789429248 00000100:00100000:1.0:1789127296.623203:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789429248 00000100:00100000:1.0:1789127296.623235:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789127296.623242:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:9517:x1876035789429248:12345-0@lo:501: 00000100:00100000:1.0:1789127296.623333:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:9517:x1876035789429248:12345-0@lo:501: Request processed in 91us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127296.623340:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789127296.623414:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789429248:0@lo:501: 00000100:00100000:3.0:1789127296.623440:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789429376:0@lo:503: 00000100:00100000:3.0:1789127296.623479:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.623505:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72d8840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127296.623594:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789429376 00000100:00100000:2.0:1789127296.623599:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789429376 00000100:00100000:2.0:1789127296.623624:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789127296.623631:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:9517:x1876035789429376:12345-0@lo:503: 00000100:00100000:2.0:1789127296.623710:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:9517:x1876035789429376:12345-0@lo:503: Request processed in 79us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127296.623716:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789127296.623801:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789429376:0@lo:503: 00000040:00080000:3.0:1789127296.623994:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127296.624080:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789429504:0@lo:502: 00000100:00100000:3.0:1789127296.624117:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.624143:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72d8840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127296.624313:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789429504 00000100:00100000:2.0:1789127296.624318:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789429504 00000100:00100000:2.0:1789127296.624349:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789127296.624356:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:9517:x1876035789429504:12345-0@lo:502: 00000100:00100000:2.0:1789127296.624439:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:9517:x1876035789429504:12345-0@lo:502: Request processed in 84us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127296.624447:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789127296.624675:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789429504:0@lo:502: 00000040:00080000:3.0:1789127296.624870:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789127296.624908:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789127296.624930:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789429632:0@lo:502: 00000100:00100000:3.0:1789127296.624964:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.624993:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72d8840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127296.625117:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789429632 00000100:00100000:2.0:1789127296.625123:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789429632 00000100:00100000:2.0:1789127296.625155:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789127296.625162:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:9517:x1876035789429632:12345-0@lo:502: 00000100:00100000:2.0:1789127296.625242:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:9517:x1876035789429632:12345-0@lo:502: Request processed in 81us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127296.625249:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789127296.625361:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789429632:0@lo:502: 00000040:00080000:3.0:1789127296.625399:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789127296.625406:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789127296.625913:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127296.625921:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127296.625923:0:9532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789127296.625928:0:9532:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff934586ebc000 00000020:00000080:3.0:1789127296.625931:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127296.625940:0:9532:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127296.625942:0:9532:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127296.625943:0:9532:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789127296.625946:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789127296.626112:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789127296.626132:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127296.626153:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d424 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.626163:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d424 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127296.626210:0:9517:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789127296.626213:0:9517:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff934586ebc000 10000000:01000000:2.0:1789127296.626216:0:9517:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff934586ebc000 10000000:01000000:2.0:1789127296.626226:0:9517:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789127296.626231:0:9517:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff934586ebc000 from 1 10000000:01000000:2.0:1789127296.626234:0:9517:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789127296.626264:0:9517:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.626271:0:9517:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.626280:0:9517:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127296.626294:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789429760:0@lo:101: 00000100:00100000:2.0:1789127296.626333:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127296.626415:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b71fc780 going to sleep for 11 seconds 00000100:00100000:1.0:1789127296.631146:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789429760 00000100:00100000:1.0:1789127296.631160:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789429760 00000100:00100000:1.0:1789127296.631217:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789127296.631226:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:9517:x1876035789429760:12345-0@lo:101: 00010000:00010000:1.0:1789127296.631242:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127296.631260:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346c214d800/0xd718aadfd785d432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d42b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.631299:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346c214d800/0xd718aadfd785d432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d42b expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.631310:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346c214d800/0xd718aadfd785d432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d42b expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.631319:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214d800, rc 0) 00000100:00100000:1.0:1789127296.631470:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9517:x1876035789429760:12345-0@lo:101: Request processed in 244us (5135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127296.631478:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789127296.632088:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789429760:0@lo:101: 00010000:00010000:0.0:1789127296.632111:0:9517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d432 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.632120:0:9517:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d432 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127296.632226:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789429888:0@lo:501: 00000100:00100000:0.0:1789127296.632283:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127296.632322:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b5414c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127296.632443:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789429888 00000100:00100000:1.0:1789127296.632448:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789429888 00000100:00100000:1.0:1789127296.632491:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789127296.632499:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9517:x1876035789429888:12345-0@lo:501: 00000100:00100000:1.0:1789127296.632631:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9517:x1876035789429888:12345-0@lo:501: Request processed in 132us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127296.632638:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789127296.632858:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789429888:0@lo:501: 00000100:00100000:0.0:1789127296.632888:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789430016:0@lo:503: 00000100:00100000:0.0:1789127296.632928:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127296.632955:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b5414c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127296.633007:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789430016 00000100:00100000:1.0:1789127296.633011:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789430016 00000100:00100000:1.0:1789127296.633056:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789127296.633063:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9517:x1876035789430016:12345-0@lo:503: 00000100:00100000:1.0:1789127296.633278:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9517:x1876035789430016:12345-0@lo:503: Request processed in 215us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127296.633286:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789127296.633356:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789430016:0@lo:503: 00000040:00080000:2.0:1789127296.633806:0:9517:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127296.633897:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789430144:0@lo:502: 00000100:00100000:2.0:1789127296.633943:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127296.634020:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b71fc180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127296.634122:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789430144 00000100:00100000:0.0:1789127296.634127:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789430144 00000100:00100000:0.0:1789127296.634212:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789127296.634222:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9517:x1876035789430144:12345-0@lo:502: 00000100:00100000:0.0:1789127296.634327:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9517:x1876035789430144:12345-0@lo:502: Request processed in 108us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127296.634335:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789127296.634410:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789430144:0@lo:502: 00000040:00080000:2.0:1789127296.634639:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789127296.634664:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789127296.634679:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789127296.634691:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789127296.634702:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789127296.634714:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789127296.634727:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789127296.634738:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789127296.634763:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789127296.634781:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789127296.634800:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789127296.634820:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789127296.634842:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789127296.634877:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789127296.634895:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789127296.634909:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789127296.634922:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789127296.634933:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789127296.634945:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789127296.634955:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789127296.634972:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789127296.634992:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789127296.635014:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789127296.635034:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789127296.635075:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1789127296.635103:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1789127296.635124:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1789127296.635146:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1789127296.635167:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1789127296.635198:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1789127296.635215:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1789127296.635248:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1789127296.635269:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1789127296.635285:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1789127296.635301:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1789127296.635317:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1789127296.635333:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1789127296.635349:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1789127296.635363:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1789127296.635376:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1789127296.635390:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1789127296.635416:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1789127296.635429:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1789127296.635444:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1789127296.635457:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1789127296.635483:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1789127296.635543:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789430272:0@lo:502: 00000100:00100000:2.0:1789127296.635606:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127296.635968:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b71fc180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127296.636456:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789430272 00000100:00100000:1.0:1789127296.636463:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789430272 00000100:00100000:1.0:1789127296.636500:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789127296.636545:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9517:x1876035789430272:12345-0@lo:502: 00000100:00100000:1.0:1789127296.636674:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9517:x1876035789430272:12345-0@lo:502: Request processed in 130us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127296.636681:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789127296.636864:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e6580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789430272:0@lo:502: 00000040:00080000:2.0:1789127296.636928:0:9517:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1789127296.636937:0:9517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1789127296.638016:0:9534:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789127296.638032:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9346b64fb490) 00000020:00000080:1.0:1789127296.638070:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1789127296.638183:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff934586ebc000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789127296.638188:0:9534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff934586ebc000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789127296.638190:0:9534:0:(obd_mount.c:710:lustre_put_lsi()) put ffff934586ebc000 3 00010000:00080000:1.0:1789127296.638221:0:9534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff934587b5d800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.148@tcp at head 00010000:00010000:2.0:1789127296.653197:0:9534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1789127296.653470:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789127296.653537:0:9534:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789127296.653551:0:9534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd718aadfd785d440 00000100:00080000:2.0:1789127296.653561:0:9534:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127296.653644:0:9534:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff934587b5d800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789127296.653681:0:9534:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9345863e6580 x1876035789430400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127296.653758:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1876035789430400:0@lo:38: 00000100:00100000:1.0:1789127296.653825:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789127296.653886:0:9534:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:2.0:1789127296.654104:0:9534:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789127296.654119:0:9534:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9346bea51a48) 00000020:00000080:2.0:1789127296.654136:0:9534:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1789127296.654194:0:9534:0:(tgt_mount.c:153:server_get_mount()) get mount ffff934586ebc000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789127296.654199:0:9534:0:(tgt_mount.c:187:server_put_mount()) put mount ffff934586ebc000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789127296.654202:0:9534:0:(obd_mount.c:710:lustre_put_lsi()) put ffff934586ebc000 3 00010000:00080000:2.0:1789127296.654228:0:9534:0:(ldlm_lib.c:102:import_set_conn()) imp ffff934587b44000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.148@tcp at head 00000100:00080000:0.0:1789127296.655658:0:9535:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9346b7397480 x1876035789430528/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127296.655671:0:9535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b5414c00 going to sleep for 0 seconds 00000100:00100000:0.0:1789127296.657200:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789430400 00000100:00100000:0.0:1789127296.657211:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789430400 00000100:00100000:0.0:1789127296.657254:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789127296.657261:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586045a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1876035789430400:12345-0@lo:38: 00010000:00080000:0.0:1789127296.657288:0:6523:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:0.0:1789127296.657330:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd718aadfd785d44e 00000004:00100000:0.0:1789127296.657345:0:6523:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789127296.657381:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9346aeced800 : changing import state from RECOVER to FULL 00010000:00010000:2.0:1789127296.661768:0:9534:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1789127296.661974:0:9534:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789127296.662031:0:9534:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789127296.663155:0:9534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd718aadfd785d455 00000100:00080000:2.0:1789127296.663169:0:9534:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127296.663175:0:9534:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff934587b44000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789127296.663212:0:9534:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9345863e5a40 x1876035789430656/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127296.664001:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3649:1876035789430656:0@lo:38: 00000100:00100000:1.0:1789127296.664085:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.664176:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789430656 00000100:00100000:3.0:1789127296.664184:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789430656 00000100:00100000:3.0:1789127296.664217:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127296.664224:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345860470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1876035789430656:12345-0@lo:38: 00010000:00080000:3.0:1789127296.664252:0:6522:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:3.0:1789127296.664285:0:6522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd718aadfd785d45c 00000004:00100000:3.0:1789127296.664301:0:6522:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789127296.664330:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9346b7dd5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127296.664375:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345860470c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876035789430656:12345-0@lo:38: Request processed in 150us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.664382:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127296.664482:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789430784:0@lo:400: 00000100:00100000:3.0:1789127296.664525:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.664543:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789431296:0@lo:400: 00000100:00100000:3.0:1789127296.664564:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.664743:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789127296.664760:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789430912:0@lo:400: 00000100:00100000:3.0:1789127296.664795:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.664815:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789431424:0@lo:400: 00000100:00100000:3.0:1789127296.664836:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.664859:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789431040:0@lo:400: 00000100:00100000:3.0:1789127296.664881:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127296.666732:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586045a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876035789430400:12345-0@lo:38: Request processed in 9461us (12897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127296.666762:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789127296.666793:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789430784 00000100:00100000:0.0:1789127296.666800:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789430784 00000100:00100000:0.0:1789127296.666830:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789431296 00000100:00100000:0.0:1789127296.666833:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789431296 00000100:00100000:0.0:1789127296.666844:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789431424 00000100:00100000:0.0:1789127296.666847:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789431424 00000100:00100000:0.0:1789127296.666859:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789431040 00000100:00100000:0.0:1789127296.666861:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789431040 00000100:00100000:0.0:1789127296.666875:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127296.666883:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789430784:12345-0@lo:400: 00000100:00100000:0.0:1789127296.667121:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789430784:12345-0@lo:400: Request processed in 238us (2612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127296.667128:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127296.667142:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789127296.667148:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789431296:12345-0@lo:400: 00000100:00100000:0.0:1789127296.667174:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789431296:12345-0@lo:400: Request processed in 27us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127296.667179:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789127296.667189:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789127296.667194:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789431424:12345-0@lo:400: 00000100:00100000:0.0:1789127296.667217:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789431424:12345-0@lo:400: Request processed in 23us (2380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127296.667222:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789127296.667231:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789127296.667236:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789431040:12345-0@lo:400: 00000100:00100000:0.0:1789127296.667257:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789431040:12345-0@lo:400: Request processed in 21us (2376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127296.667269:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789127296.667457:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345878cde00 x1876035789431040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127296.667473:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789431040:0@lo:400: 00000100:00100000:3.0:1789127296.667483:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789431552:0@lo:400: 00000100:00100000:3.0:1789127296.667533:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.667565:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789127296.667659:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789431168:0@lo:400: 00000100:00100000:3.0:1789127296.667685:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.667704:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789431680:0@lo:400: 00000100:00100000:3.0:1789127296.667722:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127296.667760:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789430912 00000100:00100000:3.0:1789127296.667764:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789430912 00000100:00100000:3.0:1789127296.667799:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789431168 00000100:00100000:3.0:1789127296.667802:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789431168 00000100:00100000:3.0:1789127296.667816:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789127296.667821:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789430912:12345-0@lo:400: 00000100:00100000:3.0:1789127296.667858:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789430912:12345-0@lo:400: Request processed in 37us (3062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.667864:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789127296.667876:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789127296.668196:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789431168:12345-0@lo:400: 00000100:00100000:3.0:1789127296.668236:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789431168:12345-0@lo:400: Request processed in 42us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.668242:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789127296.668267:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789431552 00000100:00100000:3.0:1789127296.668271:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789431552 00000100:00100000:3.0:1789127296.668293:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789431680 00000100:00100000:3.0:1789127296.668295:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789431680 00000100:00100000:3.0:1789127296.668312:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127296.668318:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789431552:12345-0@lo:400: 00000100:00100000:3.0:1789127296.668346:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789431552:12345-0@lo:400: Request processed in 27us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.668352:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127296.668363:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127296.668368:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789431680:12345-0@lo:400: 00000100:00100000:3.0:1789127296.668392:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789431680:12345-0@lo:400: Request processed in 24us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127296.668399:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127296.668435:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789430912:0@lo:400: 00010000:00080000:3.0:1789127296.668449:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345878cd2c0 x1876035789431424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127296.668460:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789431424:0@lo:400: 00010000:00080000:3.0:1789127296.668473:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345878cfc00 x1876035789430784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127296.668482:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789430784:0@lo:400: 00010000:00080000:3.0:1789127296.668505:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345878ce1c0 x1876035789431296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127296.668538:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789431296:0@lo:400: 00000100:00080000:2.0:1789127296.669179:0:9534:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1789127296.669505:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1789127296.669670:0:9517:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1789127296.669702:0:9517:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789127296.669719:0:9517:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d432 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.669730:0:9517:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d432 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789127296.669784:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789127296.669786:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789127296.669788:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127296.669789:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127296.669790:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127296.669791:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127296.669793:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127296.669795:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789127296.669796:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789127296.669798:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127296.669799:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789127296.669803:0:9517:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789127296.669805:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789127296.669806:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789127296.669807:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127296.669808:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127296.669809:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127296.669815:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127296.669816:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127296.669817:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789127296.669818:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789127296.669819:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127296.669820:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789127296.669843:0:9517:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789127296.669858:0:9517:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789431808:0@lo:253: 00000100:00100000:3.0:1789127296.670033:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789431168:0@lo:400: 00010000:00080000:1.0:1789127296.670256:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345863e6580 x1876035789430400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127296.670266:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789127296.670273:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789127296.670281:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789127296.670285:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789127296.670289:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934587b5d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789127296.670296:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ecd87b35): req@ffff9346b7397480 x1876035789430528/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127296.670318:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1876035789430400:0@lo:38: 00010000:00080000:1.0:1789127296.670348:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345863e5a40 x1876035789430656/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127296.670362:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789127296.670367:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789127296.670371:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789127296.670374:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789127296.670376:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934587b44000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789127296.670380:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3649:1876035789430656:0@lo:38: 00010000:00080000:3.0:1789127296.670443:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345878cf480 x1876035789431680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127296.670452:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789431680:0@lo:400: 00010000:00080000:3.0:1789127296.670464:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345878ce940 x1876035789431552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127296.670472:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789431552:0@lo:400: 00000100:00100000:2.0:1789127296.671195:0:9517:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127296.671230:0:9517:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ad3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127296.671749:0:9535:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127296.671776:0:9535:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b5414c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127296.671826:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789430528 00000100:00100000:2.0:1789127296.671834:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789430528 00000100:00100000:2.0:1789127296.671900:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127296.671910:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9535:x1876035789430528:12345-0@lo:901: 00000100:00100000:2.0:1789127296.672002:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9535:x1876035789430528:12345-0@lo:901: Request processed in 93us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127296.672010:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127296.672146:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789431808 00000100:00100000:1.0:1789127296.672152:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789431808 00000100:00100000:1.0:1789127296.672181:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789127296.672188:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9517:x1876035789431808:12345-0@lo:253: 20000000:01000000:1.0:1789127296.672210:0:6514:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789127296.672223:0:6514:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:0.0:1789127296.672688:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789127296.673761:0:9535:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b7397480 x1876035789430528/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789127312 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127296.673778:0:9535:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9535:1876035789430528:0@lo:901: 20000000:01000000:1.0:1789127296.677209:0:6514:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789127296.677230:0:6514:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789127296.677472:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9517:x1876035789431808:12345-0@lo:253: Request processed in 5280us (6275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127296.677484:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 20000000:01000000:0.0:1789127296.677663:0:6538:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789127296.677669:0:6538:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789127296.677690:0:6538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.677704:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d359 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d352 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.677712:0:6538:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346813c9e00/0xd718aadfd785d39f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d398 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.677720:0:6538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.677757:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346813c9e00/0xd718aadfd785d39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d398 expref: 16 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.677771:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346813c9e00/0xd718aadfd785d39f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d398 expref: 16 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127296.677786:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1876035789431936:0@lo:104: 00000100:00100000:0.0:1789127296.677822:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127296.677925:0:6538:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d352 expref: 16 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127296.677934:0:6538:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d352 expref: 16 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127296.677953:0:6538:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1876035789432064:0@lo:104: 00000100:00100000:0.0:1789127296.677976:0:6538:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127296.678070:0:9517:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e7c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:2eb81216-4f2e-430c-a0f6-5094c3b40588:9517:1876035789431808:0@lo:253: 10000000:01000000:2.0:1789127296.678083:0:9517:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789127296.678086:0:9517:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789127296.678088:0:9517:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789127296.678090:0:9517:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127296.678091:0:9517:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127296.678092:0:9517:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127296.678093:0:9517:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127296.678095:0:9517:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127296.678097:0:9517:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789127296.678098:0:9517:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789127296.678100:0:9517:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127296.678107:0:9517:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789127296.678121:0:9517:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789127296.691469:0:6538:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b5414d80 going to sleep for 11 seconds 00080000:10000000:2.0:1789127296.694294:0:9517:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789127296.694473:0:9517:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:2.0:1789127296.696309:0:9517:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789127296.696506:0:9517:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00000100:00100000:1.0:1789127296.697125:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789431936 00000100:00100000:1.0:1789127296.697135:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789431936 00000100:00100000:1.0:1789127296.697181:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789432064 00000100:00100000:1.0:1789127296.697185:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789432064 00000100:00100000:1.0:1789127296.697202:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789127296.697211:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:6538:x1876035789431936:12345-0@lo:104: 00010000:00010000:1.0:1789127296.697229:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d39f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.697320:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127296.697333:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:6538:x1876035789431936:12345-0@lo:104: Request processed in 123us (19510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127296.697341:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789127296.697358:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789127296.697364:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7395680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6538:x1876035789432064:12345-0@lo:104: 00010000:00010000:1.0:1789127296.697372:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d359 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.697409:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789127296.697413:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7395680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:6538:x1876035789432064:12345-0@lo:104: Request processed in 50us (19437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127296.697419:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789127296.698147:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127296.698154:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d39f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.698161:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1600 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127296.698165:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d39f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.698173:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d39f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127296.698180:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d39f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127296.698185:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127296.698231:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d39f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.698236:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127296.698255:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d39f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.698261:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d398 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d39f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.698283:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127296.698286:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d359 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.698291:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0600 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127296.698294:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d359 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.698302:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d359 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127296.698308:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d359 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127296.698313:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127296.698327:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d359 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.698332:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127296.698338:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d359 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.698344:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d352 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d359 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127296.698358:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127296.698360:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127296.698362:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127296.698681:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127296.698731:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1876035789431936:0@lo:104: 00000100:00100000:1.0:1789127296.698742:0:6538:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6538:1876035789432064:0@lo:104: 00010000:00010000:1.0:1789127296.698765:0:6538:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127296.699663:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789432320:0@lo:103: 00000100:00100000:0.0:1789127296.699725:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127296.699779:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127296.699786:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789432192:0@lo:103: 00000100:00100000:0.0:1789127296.699808:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127296.700151:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789432320 00000100:00100000:1.0:1789127296.700158:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789432320 00010000:00010000:1.0:1789127296.700189:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d352 expref: 17 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127296.700217:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789432192 00000100:00100000:1.0:1789127296.700220:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789432192 00010000:00010000:1.0:1789127296.700232:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346813c9e00/0xd718aadfd785d39f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d398 expref: 18 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127296.700245:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789127296.700261:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:3651:x1876035789432320:12345-0@lo:103: 00010000:00010000:1.0:1789127296.700273:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127296.700279:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d359 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d352 expref: 18 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.700289:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d359 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d352 expref: 18 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.700306:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d359 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d352 expref: 18 pid: 6516 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127296.700845:0:6508:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789127296.700853:0:6508:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1789127296.701398:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127296.701462:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:3651:x1876035789432320:12345-0@lo:103: Request processed in 1200us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127296.701472:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789127296.701498:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789127296.701522:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:3651:x1876035789432192:12345-0@lo:103: 00010000:00010000:1.0:1789127296.701535:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127296.701541:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346813c9e00/0xd718aadfd785d39f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d398 expref: 16 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.701552:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346813c9e00/0xd718aadfd785d39f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d398 expref: 16 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.701564:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346813c9e00/0xd718aadfd785d39f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d398 expref: 16 pid: 6517 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.701589:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.701609:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789127296.701623:0:6509:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.023955542s 00010000:00010000:1.0:1789127296.701628:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.701636:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.701643:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.701649:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.701655:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346813c8400 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127296.701659:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.701667:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.701684:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.701694:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127296.701720:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73970c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:3651:x1876035789432192:12345-0@lo:103: Request processed in 214us (1910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127296.701727:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789127296.701779:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789432192:0@lo:103: 00000100:00100000:1.0:1789127296.701790:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789432320:0@lo:103: 00010000:00010000:1.0:1789127296.701820:0:6538:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.701828:0:6538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127296.701833:0:6538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346813c8400/0xd718aadfd785d463 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1789127296.702087:0:9517:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:0.0:1789127296.702394:0:9517:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:2.0:1789127296.705496:0:9517:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789127296.715820:0:9517:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789127296.715829:0:9517:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789127296.715865:0:9517:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789127296.716203:0:9517:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789127296.716226:0:9517:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789127296.716244:0:9517:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789127296.725059:0:9517:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127296.725316:0:9517:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1789127296.957269:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789127297.848461:0:9591:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127297.848904:0:9591:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789127297.982211:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127299.003296:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127299.386477:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789432448:0@lo:41: 00000100:00100000:3.0:1789127299.386561:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127299.386610:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789432448 00000100:00100000:0.0:1789127299.386618:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789432448 00000100:00100000:0.0:1789127299.387137:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789127299.387149:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789432448:12345-0@lo:41: 00000004:00000024:0.0:1789127299.387181:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1789127299.387235:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789432448:12345-0@lo:41: Request processed in 88us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127299.387242:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789127299.389005:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789432448:0@lo:41: 00000100:00100000:2.0:1789127299.897154:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789432576:0@lo:41: 00000100:00100000:2.0:1789127299.897221:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127299.897414:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789432576 00000100:00100000:2.0:1789127299.897421:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789432576 00000100:00100000:2.0:1789127299.897471:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789127299.897480:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789432576:12345-0@lo:41: 00000004:00000024:2.0:1789127299.897531:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789127299.897575:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789432576:12345-0@lo:41: Request processed in 95us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127299.897583:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789127299.897625:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789432576:0@lo:41: 00010000:00010000:2.0:1789127300.025857:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127300.407629:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127300.407656:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789432704:0@lo:13: 00000100:00100000:3.0:1789127300.407744:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127300.407783:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789432704 00000100:00100000:0.0:1789127300.407790:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789432704 00000100:00100000:0.0:1789127300.407865:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127300.407875:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789432704:12345-0@lo:13: 00002000:00000024:0.0:1789127300.407903:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127300.407949:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789432704:12345-0@lo:13: Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127300.407957:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789127300.407995:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878cd2c0 x1876035789432704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127300.408012:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789432704:0@lo:13: 00000100:00080000:3.0:1789127300.408102:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127300.409592:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127300.409614:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345860452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789432832:0@lo:13: 00000100:00100000:3.0:1789127300.409664:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127300.409791:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789432832 00000100:00100000:1.0:1789127300.409798:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789432832 00000100:00100000:1.0:1789127300.409952:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127300.409960:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789432832:12345-0@lo:13: 00002000:00000024:1.0:1789127300.409978:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127300.410039:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789432832:12345-0@lo:13: Request processed in 79us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127300.410047:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789127300.414648:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789127300.414714:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345860452c0 x1876035789432832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127300.414807:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345860452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789432832:0@lo:13: 00010000:00010000:2.0:1789127301.049464:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127301.943860:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345860452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789432960:0@lo:400: 00000100:00100000:2.0:1789127301.943940:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127301.947169:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127301.947193:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789433088:0@lo:400: 00000100:00100000:2.0:1789127301.947262:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127301.947293:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789432960 00000100:00100000:3.0:1789127301.947301:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789432960 00000100:00100000:3.0:1789127301.947354:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789127301.947362:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:3652:x1876035789432960:12345-0@lo:400: 00000100:00100000:3.0:1789127301.947416:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:3652:x1876035789432960:12345-0@lo:400: Request processed in 55us (3476us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127301.947423:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789127301.947643:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789433088 00000100:00100000:2.0:1789127301.947647:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789433088 00000100:00100000:2.0:1789127301.947684:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127301.947692:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789433088:12345-0@lo:400: 00000100:00100000:2.0:1789127301.947727:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789433088:12345-0@lo:400: Request processed in 37us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127301.947733:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1789127301.947778:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b72aa940 x1876035789433088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127301.947791:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789433088:0@lo:400: 00000100:00100000:2.0:1789127301.947801:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345860452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789432960:0@lo:400: 00000100:00100000:1.0:1789127301.951493:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127301.951526:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789433216:0@lo:400: 00000100:00100000:1.0:1789127301.952936:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127301.953123:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789433216 00000100:00100000:0.0:1789127301.953132:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789433216 00000100:00100000:1.0:1789127301.953239:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127301.953256:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789433344:0@lo:400: 00000100:00100000:1.0:1789127301.953300:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127301.953330:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789433344 00000100:00100000:1.0:1789127301.953334:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789433344 00000100:00100000:1.0:1789127301.953375:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789127301.953385:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789433344:12345-0@lo:400: 00000100:00100000:1.0:1789127301.953437:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789433344:12345-0@lo:400: Request processed in 54us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127301.953445:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789127301.953482:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73912c0 x1876035789433344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127301.953495:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789433344:0@lo:400: 00000100:00100000:1.0:1789127301.953547:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789433472:0@lo:400: 00000100:00100000:1.0:1789127301.953584:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127301.953779:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789433472 00000100:00100000:0.0:1789127301.953784:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789433472 00000100:00100000:0.0:1789127301.953803:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789127301.953809:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692922580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789433216:12345-0@lo:400: 00000100:00100000:0.0:1789127301.953845:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692922580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789433216:12345-0@lo:400: Request processed in 36us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127301.953852:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789127301.953863:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789127301.953868:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7390b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789433472:12345-0@lo:400: 00000100:00100000:0.0:1789127301.953895:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7390b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789433472:12345-0@lo:400: Request processed in 27us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127301.953901:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789127301.953924:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789433472:0@lo:400: 00000100:00100000:2.0:1789127301.954136:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789433216:0@lo:400: 00000100:00100000:2.0:1789127301.954235:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789433600:0@lo:400: 00000100:00100000:2.0:1789127301.954264:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127301.954324:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789433728:0@lo:400: 00000100:00100000:1.0:1789127301.954349:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127301.954375:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789433600 00000100:00100000:1.0:1789127301.954379:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789433600 00000100:00100000:1.0:1789127301.954409:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789433728 00000100:00100000:1.0:1789127301.954412:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789433728 00000100:00100000:1.0:1789127301.954431:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789127301.954437:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789433600:12345-0@lo:400: 00000100:00100000:0.0:1789127301.954501:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789127301.954526:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346a5388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789433728:12345-0@lo:400: 00000100:00100000:0.0:1789127301.954578:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346a5388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789433728:12345-0@lo:400: Request processed in 60us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127301.954586:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789127301.954623:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73912c0 x1876035789433728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127301.954634:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789433728:0@lo:400: 00000100:00100000:1.0:1789127301.954851:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789433600:12345-0@lo:400: Request processed in 413us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127301.954859:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1789127301.954875:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127301.954879:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127301.954978:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789433856:0@lo:400: 00000100:00100000:0.0:1789127301.955025:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127301.955052:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127301.955057:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789434240:0@lo:400: 00000100:00100000:0.0:1789127301.955082:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127301.955104:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789434240 00000100:00100000:0.0:1789127301.955108:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789434240 00000100:00100000:0.0:1789127301.955137:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789127301.955143:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789434240:12345-0@lo:400: 00000100:00100000:0.0:1789127301.955187:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789434240:12345-0@lo:400: Request processed in 44us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127301.955194:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789127301.955207:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789127301.955226:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346928f4780 x1876035789434240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127301.955236:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789434240:0@lo:400: 00000100:00100000:0.0:1789127301.955254:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789433984:0@lo:400: 00000100:00100000:0.0:1789127301.955277:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127301.955295:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127301.955308:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789434112:0@lo:400: 00000100:00100000:0.0:1789127301.955329:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127301.955354:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789433856 00000100:00100000:0.0:1789127301.955357:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789433856 00000100:00100000:0.0:1789127301.955381:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789433984 00000100:00100000:0.0:1789127301.955384:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789433984 00000100:00100000:0.0:1789127301.955400:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127301.955406:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7396580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789433856:12345-0@lo:400: 00000100:00100000:0.0:1789127301.955438:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7396580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789433856:12345-0@lo:400: Request processed in 33us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127301.955445:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127301.955455:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127301.955461:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789433984:12345-0@lo:400: 00000100:00100000:0.0:1789127301.955487:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789433984:12345-0@lo:400: Request processed in 26us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127301.955493:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127301.955529:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789434112 00000100:00100000:0.0:1789127301.955533:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789434112 00000100:00100000:0.0:1789127301.955559:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789127301.955565:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7395a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789434112:12345-0@lo:400: 00010000:00080000:1.0:1789127301.955823:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346928f6940 x1876035789433856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127301.955833:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789433856:0@lo:400: 00000100:00080000:1.0:1789127301.955866:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789127301.955883:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346928f6d00 x1876035789433984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127301.955891:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789433984:0@lo:400: 00000100:00100000:0.0:1789127301.955986:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7395a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789434112:12345-0@lo:400: Request processed in 422us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127301.955993:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789127301.956095:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346928f61c0 x1876035789434112/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127301.956104:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789434112:0@lo:400: 00010000:00080000:2.0:1789127301.956198:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7390780 x1876035789433600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127317 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127301.956208:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789433600:0@lo:400: 00010000:00010000:0.0:1789127302.071937:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789127302.752271:0:9881:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789127303.096761:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789127303.617453:0:9933:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127303.617729:0:9933:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789127304.123702:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789127304.503617:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789127304.503625:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9346b6688800 from 39 10000000:01000000:0.0:1789127304.503630:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789127304.503689:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127304.503700:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127304.503711:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127304.503734:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7395e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789434368:0@lo:101: 00000100:00100000:0.0:1789127304.503805:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.503831:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127304.503846:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789434496:0@lo:41: 00000100:00100000:0.0:1789127304.503859:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b5414300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127304.503877:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.503963:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789434368 00000100:00100000:3.0:1789127304.503971:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789434368 00000100:00100000:3.0:1789127304.504034:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789127304.504043:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:6520:x1876035789434368:12345-0@lo:101: 00010000:00010000:3.0:1789127304.504055:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127304.504067:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d471 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d46a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.504088:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d46a expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.504099:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d46a expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.504108:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a0200, rc 0) 00000100:00100000:3.0:1789127304.504145:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789434368:12345-0@lo:101: Request processed in 103us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127304.504161:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789127304.504207:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7395e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789434368:0@lo:101: 00010000:00010000:3.0:1789127304.504222:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d471 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.504230:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d471 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127304.504495:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789434624:0@lo:501: 00000100:00100000:3.0:1789127304.504556:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.504574:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127304.504635:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789434624 00000100:00100000:2.0:1789127304.504640:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789434624 00000100:00100000:2.0:1789127304.504673:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789127304.504690:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789434624:12345-0@lo:501: 00000100:00100000:0.0:1789127304.504719:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789434496 00000100:00100000:0.0:1789127304.504724:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789434496 00000100:00100000:0.0:1789127304.504752:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789127304.504758:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789434496:12345-0@lo:41: 00000004:00000024:0.0:1789127304.504786:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1789127304.504800:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789434624:12345-0@lo:501: Request processed in 120us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127304.504807:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789127304.504820:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789434496:12345-0@lo:41: Request processed in 63us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.504826:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789127304.504857:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789434624:0@lo:501: 00000100:00100000:2.0:1789127304.504860:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789434496:0@lo:41: 00000100:00100000:0.0:1789127304.504885:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789434752:0@lo:503: 00000100:00100000:0.0:1789127304.504923:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127304.504948:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b5414180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127304.505211:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789434752 00000100:00100000:1.0:1789127304.505216:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789434752 00000100:00100000:1.0:1789127304.505238:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789127304.505244:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789434752:12345-0@lo:503: 00000100:00100000:1.0:1789127304.505462:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789434752:12345-0@lo:503: Request processed in 216us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.505469:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789127304.506636:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789434752:0@lo:503: 00000100:00100000:0.0:1789127304.507104:0:9985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9985:1876035789434880:0@lo:502: 00000100:00100000:0.0:1789127304.507165:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127304.507211:0:9985:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b5414b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127304.507351:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789434880 00000100:00100000:1.0:1789127304.507357:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789434880 00000100:00100000:1.0:1789127304.507451:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789127304.507461:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:9985:x1876035789434880:12345-0@lo:502: 00000100:00100000:1.0:1789127304.507601:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:9985:x1876035789434880:12345-0@lo:502: Request processed in 140us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.507608:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789127304.507685:0:9985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9985:1876035789434880:0@lo:502: 00000100:00100000:0.0:1789127304.507727:0:9985:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9985:1876035789435008:0@lo:502: 00000100:00100000:0.0:1789127304.507760:0:9985:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.517767:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789435008 00000100:00100000:0.0:1789127304.517809:0:9985:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b5414b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127304.517844:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789435008 00000100:00100000:3.0:1789127304.518087:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789127304.518102:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:9985:x1876035789435008:12345-0@lo:502: 00000100:00100000:3.0:1789127304.518269:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:9985:x1876035789435008:12345-0@lo:502: Request processed in 168us (10508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127304.518277:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789127304.523495:0:9985:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9985:1876035789435008:0@lo:502: 00000040:00080000:0.0:1789127304.523569:0:9985:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789127304.523925:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789127304.523952:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127304.523965:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d471 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.523976:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d471 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127304.523985:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789127304.524010:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789127304.524013:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789127304.524049:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.524057:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.524067:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127304.524087:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789435136:0@lo:101: 00000100:00100000:3.0:1789127304.524149:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.524184:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127304.524202:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789435136 00000100:00100000:3.0:1789127304.524206:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789435136 00000100:00100000:3.0:1789127304.524239:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789127304.524247:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789435136:12345-0@lo:101: 00010000:00010000:3.0:1789127304.524257:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127304.524269:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93469a7a0400/0xd718aadfd785d47f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d478 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.524288:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93469a7a0400/0xd718aadfd785d47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d478 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.524297:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93469a7a0400/0xd718aadfd785d47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d478 expref: 17 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.524305:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a0400, rc 0) 00000100:00100000:3.0:1789127304.524340:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789435136:12345-0@lo:101: Request processed in 92us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127304.524353:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789127304.525262:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789435136:0@lo:101: 00010000:00010000:3.0:1789127304.525282:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d47f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.525292:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d47f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127304.525354:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789435264:0@lo:501: 00000100:00100000:3.0:1789127304.526159:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.526224:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127304.526302:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789435264 00000100:00100000:1.0:1789127304.526309:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789435264 00000100:00100000:2.0:1789127304.527137:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789127304.527151:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789435264:12345-0@lo:501: 00000100:00100000:2.0:1789127304.527310:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789435264:12345-0@lo:501: Request processed in 163us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127304.527318:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789127304.527414:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789435264:0@lo:501: 00000100:00100000:3.0:1789127304.527453:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789435392:0@lo:503: 00000100:00100000:3.0:1789127304.527491:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.535218:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.542023:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789435392 00000100:00100000:0.0:1789127304.542036:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789435392 00000100:00100000:3.0:1789127304.542263:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789127304.542273:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789435392:12345-0@lo:503: 00000100:00100000:3.0:1789127304.542759:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789435392:12345-0@lo:503: Request processed in 486us (15265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127304.542767:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789127304.544802:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789435392:0@lo:503: 00000100:00100000:0.0:1789127304.545290:0:9986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9986:1876035789435520:0@lo:502: 00000100:00100000:0.0:1789127304.545355:0:9986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.545682:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789435520 00000100:00100000:3.0:1789127304.545689:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789435520 00000100:00100000:3.0:1789127304.545735:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789127304.545746:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9986:x1876035789435520:12345-0@lo:502: 00000100:00100000:3.0:1789127304.545857:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9986:x1876035789435520:12345-0@lo:502: Request processed in 112us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127304.545871:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789127304.546056:0:9986:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b5414480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.546076:0:9986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9986:1876035789435520:0@lo:502: 00000020:01000000:0.0:1789127304.546103:0:9986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127304.546112:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127304.546114:0:9986:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789127304.546119:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789127304.546121:0:9986:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789127304.546139:0:9986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9986:1876035789435648:0@lo:502: 00000100:00100000:0.0:1789127304.546181:0:9986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127304.546210:0:9986:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b5414480 going to sleep for 11 seconds 00000100:00100000:3.0:1789127304.546316:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789435648 00000100:00100000:3.0:1789127304.546320:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789435648 00000100:00100000:3.0:1789127304.546350:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789127304.546357:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9986:x1876035789435648:12345-0@lo:502: 00000100:00100000:3.0:1789127304.546652:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:9986:x1876035789435648:12345-0@lo:502: Request processed in 294us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127304.546659:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789127304.546743:0:9986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9986:1876035789435648:0@lo:502: 00000020:01000000:2.0:1789127304.546763:0:9986:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127304.546767:0:9986:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127304.546769:0:9986:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789127304.546772:0:9986:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1789127304.546928:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789127304.546949:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789127304.546963:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d47f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.546973:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d47f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127304.546982:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789127304.546984:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9346b640b000 from 39 10000000:01000000:3.0:1789127304.546987:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789127304.547021:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.547028:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.547036:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127304.547048:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789435776:0@lo:101: 00000100:00100000:3.0:1789127304.547085:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.547270:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127304.547343:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789435776 00000100:00100000:1.0:1789127304.547348:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789435776 00000100:00100000:1.0:1789127304.547733:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789127304.547750:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789435776:12345-0@lo:101: 00010000:00010000:1.0:1789127304.547760:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127304.547773:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346c214c600/0xd718aadfd785d48d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d486 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127304.547793:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346c214c600/0xd718aadfd785d48d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d486 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127304.547802:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346c214c600/0xd718aadfd785d48d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d486 expref: 18 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127304.547811:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214c600, rc 0) 00000100:00100000:1.0:1789127304.547850:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789435776:12345-0@lo:101: Request processed in 103us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127304.547898:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789435776:0@lo:101: 00010000:00010000:2.0:1789127304.547912:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d48d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127304.547921:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d48d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127304.547976:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789435904:0@lo:501: 00000100:00100000:2.0:1789127304.548017:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.548033:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.548118:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789435904 00000100:00100000:0.0:1789127304.548123:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789435904 00000100:00100000:1.0:1789127304.552612:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789127304.553183:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789127304.553201:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789435904:12345-0@lo:501: 00000100:00100000:0.0:1789127304.553486:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789435904:12345-0@lo:501: Request processed in 292us (5468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.553525:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789127304.553625:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789435904:0@lo:501: 00000100:00100000:2.0:1789127304.553676:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789436032:0@lo:503: 00000100:00100000:2.0:1789127304.553722:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.553747:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2e180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127304.553811:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789436032 00000100:00100000:3.0:1789127304.553817:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789436032 00000100:00100000:3.0:1789127304.553860:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789127304.553868:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789436032:12345-0@lo:503: 00000100:00100000:3.0:1789127304.553947:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789436032:12345-0@lo:503: Request processed in 81us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127304.553954:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789127304.554069:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e70c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789436032:0@lo:503: 00000100:00100000:1.0:1789127304.556037:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9987:1876035789436160:0@lo:502: 00000100:00100000:1.0:1789127304.556117:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127304.556160:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127304.556231:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789436160 00000100:00100000:3.0:1789127304.556238:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789436160 00000100:00100000:3.0:1789127304.556281:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789127304.556291:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:9987:x1876035789436160:12345-0@lo:502: 00000100:00100000:3.0:1789127304.556566:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:9987:x1876035789436160:12345-0@lo:502: Request processed in 275us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127304.556574:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789127304.560776:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9987:1876035789436160:0@lo:502: 00000100:00100000:1.0:1789127304.560868:0:9987:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9987:1876035789436288:0@lo:502: 00000100:00100000:1.0:1789127304.560939:0:9987:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127304.561027:0:9987:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127304.563832:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789436288 00000100:00100000:2.0:1789127304.563845:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789436288 00000100:00100000:2.0:1789127304.563939:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789127304.563965:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:9987:x1876035789436288:12345-0@lo:502: 00000100:00100000:2.0:1789127304.564129:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:9987:x1876035789436288:12345-0@lo:502: Request processed in 166us (3188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127304.564137:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789127304.564239:0:9987:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9987:1876035789436288:0@lo:502: 00000040:00080000:1.0:1789127304.564273:0:9987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789127304.564760:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789127304.564783:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127304.564793:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d48d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.564804:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d48d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127304.564814:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789127304.564816:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9346b640b000 from 6 10000000:01000000:3.0:1789127304.564819:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789127304.564852:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.564869:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.564879:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127304.564898:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789436416:0@lo:101: 00000100:00100000:3.0:1789127304.564939:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.566435:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65adcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.566641:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789436416 00000100:00100000:0.0:1789127304.566649:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789436416 00000100:00100000:0.0:1789127304.566695:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789127304.566704:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789436416:12345-0@lo:101: 00010000:00010000:0.0:1789127304.566718:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127304.566737:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346813c8c00/0xd718aadfd785d49b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d494 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127304.566760:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346813c8c00/0xd718aadfd785d49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d494 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127304.566770:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346813c8c00/0xd718aadfd785d49b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d494 expref: 19 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127304.566779:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346813c8c00, rc 0) 00000100:00100000:0.0:1789127304.566828:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:6520:x1876035789436416:12345-0@lo:101: Request processed in 125us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.566835:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789127304.566945:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789436416:0@lo:101: 00010000:00010000:3.0:1789127304.566967:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.566976:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127304.567052:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789436544:0@lo:256: 00000100:00100000:3.0:1789127304.567090:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.567119:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65adcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.567165:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789436544 00000100:00100000:0.0:1789127304.567169:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789436544 00000100:00100000:0.0:1789127304.567189:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789127304.567194:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:6520:x1876035789436544:12345-0@lo:256: 20000000:01000000:0.0:1789127304.567206:0:6514:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789127304.567222:0:6514:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789127304.567225:0:6514:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789127304.567306:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:6520:x1876035789436544:12345-0@lo:256: Request processed in 111us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.567321:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789127304.567685:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789436544:0@lo:256: 10000000:01000000:3.0:1789127304.567738:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789127304.567745:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.567753:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127304.567771:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789127304.567774:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:3.0:1789127304.567776:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789127304.567798:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.567805:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.567813:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127304.567825:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789436672:0@lo:101: 00000100:00100000:3.0:1789127304.567853:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.567874:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aed09a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127304.570888:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789436672 00000100:00100000:2.0:1789127304.570901:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789436672 00000100:00100000:2.0:1789127304.570960:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789127304.570970:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:6520:x1876035789436672:12345-0@lo:101: 00010000:00010000:2.0:1789127304.570986:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127304.571014:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928fea00/0xd718aadfd785d4a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d4a2 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127304.571041:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928fea00/0xd718aadfd785d4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d4a2 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127304.571051:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928fea00/0xd718aadfd785d4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d4a2 expref: 20 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127304.571059:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fea00, rc 0) 00000100:00100000:2.0:1789127304.571125:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789436672:12345-0@lo:101: Request processed in 157us (3270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127304.571132:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789127304.574547:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789436672:0@lo:101: 00010000:00010000:3.0:1789127304.574577:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d4a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.574589:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d4a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127304.574672:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789436800:0@lo:501: 00000100:00100000:3.0:1789127304.574723:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.574763:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aed09a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127304.574848:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789436800 00000100:00100000:2.0:1789127304.574854:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789436800 00000100:00100000:2.0:1789127304.574896:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789127304.574906:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789436800:12345-0@lo:501: 00000100:00100000:2.0:1789127304.575051:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789436800:12345-0@lo:501: Request processed in 146us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127304.575073:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789127304.575216:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789436800:0@lo:501: 00000100:00100000:3.0:1789127304.575243:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789436928:0@lo:503: 00000100:00100000:3.0:1789127304.575288:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.575315:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aed09a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127304.575484:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789436928 00000100:00100000:1.0:1789127304.575490:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789436928 00000100:00100000:1.0:1789127304.575785:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789127304.575802:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789436928:12345-0@lo:503: 00000100:00100000:1.0:1789127304.575903:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789436928:12345-0@lo:503: Request processed in 104us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.575910:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789127304.579343:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789436928:0@lo:503: 00000100:00100000:2.0:1789127304.579834:0:9988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9988:1876035789437056:0@lo:502: 00000100:00100000:2.0:1789127304.579911:0:9988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.579954:0:9988:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.580018:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789437056 00000100:00100000:0.0:1789127304.580024:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789437056 00000100:00100000:0.0:1789127304.580075:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789127304.580084:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:9988:x1876035789437056:12345-0@lo:502: 00000100:00100000:0.0:1789127304.580214:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:9988:x1876035789437056:12345-0@lo:502: Request processed in 131us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.580222:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789127304.580331:0:9988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e70c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9988:1876035789437056:0@lo:502: 00000020:01000000:2.0:1789127304.580354:0:9988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789127304.580362:0:9988:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789127304.580369:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127304.580371:0:9988:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789127304.580376:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789127304.580379:0:9988:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:2.0:1789127304.580399:0:9988:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789127304.580402:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789127304.580426:0:9988:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff934587ddb490) 00000020:00000080:2.0:1789127304.580450:0:9988:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1789127304.580456:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789127304.580557:0:9988:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789127304.580564:0:9988:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789127304.580570:0:9988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd718aadfd785d4b7 00010000:00080000:2.0:1789127304.580605:0:9988:0:(ldlm_lib.c:102:import_set_conn()) imp ffff93458621d800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.148@tcp at head 00010000:00010000:2.0:1789127304.580817:0:9988:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1789127304.580941:0:9988:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789127304.580952:0:9988:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789127304.581133:0:9988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127304.581248:0:9988:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127304.581384:0:9988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789127304.581476:0:9988:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789127304.588138:0:9989:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789127304.588146:0:9989:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789127304.590256:0:9988:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789127304.590271:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789127304.590313:0:9988:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789127304.590338:0:9988:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd718aadfd785d4be 00000100:00080000:3.0:1789127304.590360:0:9988:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127304.590367:0:9988:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff93458621d800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789127304.590405:0:9988:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9345878cf480 x1876035789437184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127304.590431:0:9988:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789127304.590492:0:9988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127304.590497:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127304.590499:0:9988:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789127304.590502:0:9988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127304.590540:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127304.590542:0:9988:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789127304.590548:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789127304.590551:0:9988:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789127304.590578:0:9988:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9988:1876035789437440:0@lo:502: 00000100:00100000:0.0:1789127304.590649:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789437568:0@lo:400: 00000100:00100000:3.0:1789127304.590673:0:9988:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.590727:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789437312:0@lo:400: 00000100:00100000:1.0:1789127304.590738:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789437184:0@lo:8: 00000100:00100000:0.0:1789127304.591945:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127304.591991:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789438080:0@lo:400: 00000100:00100000:0.0:1789127304.592041:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127304.592086:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7395e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789437696:0@lo:400: 00000100:00100000:0.0:1789127304.592115:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127304.592137:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789438208:0@lo:400: 00000100:00100000:0.0:1789127304.592158:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127304.592177:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789127304.592183:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789437824:0@lo:400: 00000100:00100000:0.0:1789127304.592205:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127304.592222:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789438336:0@lo:400: 00000100:00100000:0.0:1789127304.592241:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127304.592272:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789437568 00000100:00100000:0.0:1789127304.592279:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789437568 00000100:00100000:0.0:1789127304.592328:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789437824 00000100:00100000:0.0:1789127304.592332:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789437824 00000100:00100000:0.0:1789127304.592352:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789438336 00000100:00100000:0.0:1789127304.592354:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789438336 00000100:00100000:0.0:1789127304.592369:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789127304.592376:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789437568:12345-0@lo:400: 00000100:00100000:0.0:1789127304.592443:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789437568:12345-0@lo:400: Request processed in 67us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.592451:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789127304.592466:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789127304.592472:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789437824:12345-0@lo:400: 00000100:00100000:0.0:1789127304.592503:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789437824:12345-0@lo:400: Request processed in 31us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.592529:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789127304.592542:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789127304.592548:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789438336:12345-0@lo:400: 00000100:00100000:0.0:1789127304.592575:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789438336:12345-0@lo:400: Request processed in 28us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.592581:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789127304.592599:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789438080 00000100:00100000:0.0:1789127304.592603:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789438080 00000100:00100000:0.0:1789127304.592626:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789438208 00000100:00100000:0.0:1789127304.592628:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789438208 00000100:00100000:0.0:1789127304.592647:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127304.592653:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789438080:12345-0@lo:400: 00000100:00100000:0.0:1789127304.592684:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789438080:12345-0@lo:400: Request processed in 31us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.592690:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127304.592710:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127304.592716:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789438208:12345-0@lo:400: 00000100:00100000:0.0:1789127304.592744:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789438208:12345-0@lo:400: Request processed in 29us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.592750:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789127304.592791:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73952c0 x1876035789437824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127304.592805:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789437824:0@lo:400: 00010000:00080000:0.0:1789127304.592817:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587eb92c0 x1876035789438336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127304.592826:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789438336:0@lo:400: 00010000:00080000:0.0:1789127304.592836:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587eba1c0 x1876035789438208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127304.592844:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789438208:0@lo:400: 00010000:00080000:0.0:1789127304.592876:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7396d00 x1876035789437568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127304.592885:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789437568:0@lo:400: 00010000:00080000:0.0:1789127304.592896:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73912c0 x1876035789438080/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127304.592903:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789438080:0@lo:400: 00000100:00100000:2.0:1789127304.594711:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.594767:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789437952:0@lo:400: 00000100:00100000:2.0:1789127304.594803:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.594822:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789438464:0@lo:400: 00000100:00100000:2.0:1789127304.594848:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127304.596267:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127304.596339:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789437696 00000100:00100000:1.0:1789127304.596362:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789437696 00000100:00100000:1.0:1789127304.596416:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789127304.596426:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789437696:12345-0@lo:400: 00000100:00100000:1.0:1789127304.596488:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789437696:12345-0@lo:400: Request processed in 64us (4372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.596495:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789127304.596531:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789437184 00000100:00100000:1.0:1789127304.596534:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789437184 00000100:00100000:1.0:1789127304.596547:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127304.596552:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3649:x1876035789437184:12345-0@lo:8: 00010000:00080000:1.0:1789127304.596593:0:8438:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:1.0:1789127304.596624:0:8438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd718aadfd785d4c5 00002000:00100000:1.0:1789127304.596649:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff934587b5a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113987 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1789127304.596654:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:1.0:1789127304.596657:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789127304.596716:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789127304.596945:0:8438:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1789127304.596969:0:8438:0:(import.c:65:import_set_state_nolock()) ffff934587b5c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127304.597021:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1876035789437184:12345-0@lo:8: Request processed in 467us (759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.597034:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127304.597069:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789437312 00000100:00100000:1.0:1789127304.597073:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789437312 00000100:00100000:1.0:1789127304.597095:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789437952 00000100:00100000:1.0:1789127304.597098:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789437952 00000100:00100000:1.0:1789127304.597112:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789438464 00000100:00100000:1.0:1789127304.597114:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789438464 00000100:00100000:1.0:1789127304.597130:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789127304.597137:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789437312:12345-0@lo:400: 00000100:00100000:1.0:1789127304.597178:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789437312:12345-0@lo:400: Request processed in 41us (2472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.597184:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789127304.597195:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789127304.597201:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789437952:12345-0@lo:400: 00000100:00100000:1.0:1789127304.597229:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789437952:12345-0@lo:400: Request processed in 29us (2425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.597235:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789127304.597245:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789127304.597250:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789438464:12345-0@lo:400: 00000100:00100000:1.0:1789127304.597272:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789438464:12345-0@lo:400: Request processed in 22us (2424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.597278:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789127304.597291:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127304.597295:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789127304.597297:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127304.597341:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7395e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789437696:0@lo:400: 00010000:00080000:1.0:1789127304.597379:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7397480 x1876035789437312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127304.597397:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789437312:0@lo:400: 00010000:00080000:1.0:1789127304.597411:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7390780 x1876035789437952/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127304.597419:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789437952:0@lo:400: 00010000:00080000:1.0:1789127304.597428:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587eba940 x1876035789438464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127304.597436:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789438464:0@lo:400: 00010000:00080000:1.0:1789127304.597467:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878cf480 x1876035789437184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127304.597475:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789127304.597482:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1789127304.597490:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789127304.597495:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789127304.597498:0:3649:0:(import.c:65:import_set_state_nolock()) ffff93458621d800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789127304.597536:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789127304.597541:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789437184:0@lo:8: 00000004:00080000:0.0:1789127304.599037:0:9989:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789127304.599117:0:9989:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 265791607004ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789127304.599125:0:9989:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789127304.602456:0:9990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9990:1876035789438592:0@lo:700: 00000100:00100000:2.0:1789127304.602537:0:9990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.602571:0:9990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127304.603256:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789437440 00000100:00100000:2.0:1789127304.603264:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789437440 00000100:00100000:2.0:1789127304.603319:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789127304.603328:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:9988:x1876035789437440:12345-0@lo:502: 00000100:00100000:2.0:1789127304.603461:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:9988:x1876035789437440:12345-0@lo:502: Request processed in 134us (12789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127304.603469:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789127304.604852:0:8447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789438592 00000100:00100000:2.0:1789127304.604862:0:8447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789438592 00000100:00100000:2.0:1789127304.604922:0:8447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127304.604933:0:8447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9990:x1876035789438592:12345-0@lo:700: 00000100:00100000:2.0:1789127304.604984:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8447:1876035789438720:0@lo:700: 00000100:00080000:1.0:1789127304.605053:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127304.605054:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.605083:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127304.605338:0:9988:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aed09a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127304.605434:0:9988:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9988:1876035789437440:0@lo:502: 00000020:01000000:3.0:1789127304.605470:0:9988:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127304.605477:0:9988:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127304.605480:0:9988:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789127304.605484:0:9988:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:0.0:1789127304.606277:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789438720 00000100:00100000:0.0:1789127304.606289:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789438720 00000100:00100000:0.0:1789127304.606338:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127304.606347:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8447:x1876035789438720:12345-0@lo:700: 00000020:01000000:2.0:1789127304.609227:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1789127304.609258:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789127304.609269:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d4a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127304.609297:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d4a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127304.609307:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789127304.609310:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff934687bf9800 from 39 10000000:01000000:2.0:1789127304.609313:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789127304.609351:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127304.609359:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127304.609382:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127304.609414:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789438848:0@lo:101: 00000100:00100000:2.0:1789127304.609491:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.609560:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.609840:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789438848 00000100:00100000:0.0:1789127304.609849:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789438848 00000100:00100000:0.0:1789127304.609903:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789127304.609913:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789438848:12345-0@lo:101: 00010000:00010000:0.0:1789127304.609926:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127304.609940:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346813c9800/0xd718aadfd785d4d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d4cc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127304.609963:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346813c9800/0xd718aadfd785d4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d4cc expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127304.609973:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346813c9800/0xd718aadfd785d4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d4cc expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127304.609980:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346813c9800, rc 0) 00000100:00100000:0.0:1789127304.610165:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789438848:12345-0@lo:101: Request processed in 253us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.610172:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789127304.610499:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789438848:0@lo:101: 00010000:00010000:3.0:1789127304.610544:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d4d3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.610561:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d4d3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127304.610629:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789438976:0@lo:501: 00000100:00100000:3.0:1789127304.610674:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.610695:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aed09a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127304.610816:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789438976 00000100:00100000:2.0:1789127304.610820:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789438976 00000100:00100000:2.0:1789127304.610870:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1789127304.610879:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789438976:12345-0@lo:501: 00000100:00100000:2.0:1789127304.610995:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789438976:12345-0@lo:501: Request processed in 117us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127304.611013:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789127304.611159:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789438976:0@lo:501: 00000100:00100000:3.0:1789127304.611189:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789439104:0@lo:503: 00000100:00100000:3.0:1789127304.611227:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.611258:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aed09a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127304.611926:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789439104 00000100:00100000:2.0:1789127304.611934:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789439104 00000100:00100000:2.0:1789127304.611967:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789127304.611982:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789439104:12345-0@lo:503: 00000100:00100000:2.0:1789127304.612477:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789439104:12345-0@lo:503: Request processed in 495us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127304.612485:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789127304.613175:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789439104:0@lo:503: 00000004:00080000:1.0:1789127304.616610:0:7454:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789127304.618167:0:9991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9991:1876035789439232:0@lo:502: 00000100:00100000:2.0:1789127304.618256:0:9991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.618344:0:9991:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2e000 going to sleep for 11 seconds 00000100:00100000:1.0:1789127304.618436:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789439232 00000100:00100000:1.0:1789127304.618443:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789439232 00000100:00100000:1.0:1789127304.618546:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789127304.618556:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:9991:x1876035789439232:12345-0@lo:502: 00000100:00100000:1.0:1789127304.618740:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:9991:x1876035789439232:12345-0@lo:502: Request processed in 186us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.618758:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789127304.618846:0:9991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9991:1876035789439232:0@lo:502: 00000100:00100000:2.0:1789127304.618895:0:9991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9991:1876035789439360:0@lo:502: 00000100:00100000:2.0:1789127304.618930:0:9991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.618953:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789439360 00000100:00100000:2.0:1789127304.618957:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789439360 00000100:00100000:2.0:1789127304.618984:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789127304.618992:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:9991:x1876035789439360:12345-0@lo:502: 40000000:02000000:3.0:1789127304.626885:0:6529:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:2.0:1789127304.626975:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:9991:x1876035789439360:12345-0@lo:502: Request processed in 7979us (8040us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127304.626989:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789127304.627093:0:9991:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127304.627118:0:9991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e6d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9991:1876035789439360:0@lo:502: 00000040:00080000:2.0:1789127304.627155:0:9991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789127304.627890:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789127304.627914:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789127304.627925:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d4d3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127304.627935:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d4d3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127304.627944:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789127304.627946:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff934687bf9800 from 6 10000000:01000000:1.0:1789127304.627949:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789127304.627981:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127304.627990:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127304.628010:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127304.628029:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789439488:0@lo:101: 00000100:00100000:1.0:1789127304.628147:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127304.628220:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127304.628267:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789439488 00000100:00100000:2.0:1789127304.628274:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789439488 00000100:00100000:2.0:1789127304.628413:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789127304.628424:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789439488:12345-0@lo:101: 00010000:00010000:2.0:1789127304.628449:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127304.628461:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928ff200/0xd718aadfd785d4e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d4da expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127304.628484:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928ff200/0xd718aadfd785d4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d4da expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127304.628494:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928ff200/0xd718aadfd785d4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d4da expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127304.628534:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff200, rc 0) 00000100:00100000:2.0:1789127304.628587:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789439488:12345-0@lo:101: Request processed in 150us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127304.628595:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789127304.628814:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789439488:0@lo:101: 00010000:00010000:1.0:1789127304.628830:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127304.628839:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127304.628892:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789439616:0@lo:256: 00000100:00100000:1.0:1789127304.628927:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127304.628956:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127304.629004:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789439616 00000100:00100000:2.0:1789127304.629009:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789439616 00000100:00100000:2.0:1789127304.629136:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789127304.629146:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789439616:12345-0@lo:256: 20000000:01000000:2.0:1789127304.629160:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789127304.629174:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789127304.629177:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789127304.629251:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789439616:12345-0@lo:256: Request processed in 106us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127304.629257:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789127304.632710:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789439616:0@lo:256: 10000000:01000000:1.0:1789127304.632784:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789127304.632794:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127304.632804:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127304.632813:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789127304.632815:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1789127304.632818:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789127304.632852:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127304.632859:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127304.632868:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127304.632887:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789439744:0@lo:101: 00000100:00100000:1.0:1789127304.632950:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127304.632981:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5000 going to sleep for 11 seconds 00000100:00100000:1.0:1789127304.633018:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789439744 00000100:00100000:1.0:1789127304.633033:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789439744 00000100:00100000:1.0:1789127304.633198:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789127304.633206:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789439744:12345-0@lo:101: 00010000:00010000:1.0:1789127304.633217:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127304.633229:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346c214dc00/0xd718aadfd785d4ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d4e8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127304.633250:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346c214dc00/0xd718aadfd785d4ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d4e8 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127304.633260:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346c214dc00/0xd718aadfd785d4ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d4e8 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127304.633268:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214dc00, rc 0) 00000100:00100000:1.0:1789127304.633302:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789439744:12345-0@lo:101: Request processed in 97us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.633309:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789127304.633346:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789439744:0@lo:101: 00010000:00010000:1.0:1789127304.633357:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d4ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127304.633366:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d4ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127304.633417:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789439872:0@lo:501: 00000100:00100000:1.0:1789127304.633448:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127304.633461:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5000 going to sleep for 11 seconds 00000100:00100000:1.0:1789127304.633471:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789439872 00000100:00100000:1.0:1789127304.633474:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789439872 00000100:00100000:1.0:1789127304.633500:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789127304.633506:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789439872:12345-0@lo:501: 00000100:00100000:1.0:1789127304.634302:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789439872:12345-0@lo:501: Request processed in 793us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.634310:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789127304.634357:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789439872:0@lo:501: 00000100:00100000:1.0:1789127304.634404:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789440000:0@lo:503: 00000100:00100000:1.0:1789127304.634445:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127304.634461:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5000 going to sleep for 11 seconds 00000100:00100000:1.0:1789127304.634474:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789440000 00000100:00100000:1.0:1789127304.634477:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789440000 00000100:00100000:1.0:1789127304.634502:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789127304.634533:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789440000:12345-0@lo:503: 00000100:00100000:1.0:1789127304.634615:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789440000:12345-0@lo:503: Request processed in 106us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.634621:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789127304.635350:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789440000:0@lo:503: 00000100:00100000:3.0:1789127304.640759:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8447:x1876035789438720:12345-0@lo:700: Request processed in 34406us (35699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127304.640776:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789127304.640793:0:8447:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345863e5a40 x1876035789438720/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789127320 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127304.640810:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e5a40 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8447:1876035789438720:0@lo:700: 40000000:02000000:1.0:1789127304.640826:0:8447:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1789127304.641875:0:9992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9992:1876035789440128:0@lo:502: 00000100:00100000:3.0:1789127304.641954:0:9992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.641994:0:9992:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aed09000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127304.644867:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789440128 00000100:00100000:2.0:1789127304.644881:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789440128 00000100:00100000:2.0:1789127304.644941:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789127304.644951:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:9992:x1876035789440128:12345-0@lo:502: 00000100:00100000:0.0:1789127304.645784:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:9992:x1876035789440128:12345-0@lo:502: Request processed in 830us (3828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.645794:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789127304.645897:0:9992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9992:1876035789440128:0@lo:502: 00000020:01000000:3.0:1789127304.645935:0:9992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789127304.645943:0:9992:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789127304.645950:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127304.645952:0:9992:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789127304.645958:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789127304.645962:0:9992:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:3.0:1789127304.645983:0:9992:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789127304.645994:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127304.646035:0:9992:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff934587f44ed8) 00000020:00000080:3.0:1789127304.646059:0:9992:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1789127304.646067:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789127304.646151:0:9992:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789127304.646157:0:9992:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789127304.646163:0:9992:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785d4fd 00010000:00080000:3.0:1789127304.646189:0:9992:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9346b7dd0800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1789127304.646632:0:9992:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1789127304.646759:0:9992:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789127304.646771:0:9992:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789127304.646933:0:9992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127304.647122:0:9992:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127304.647257:0:9992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789127304.647348:0:9992:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1789127304.647827:0:9993:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127304.647837:0:9993:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789127304.648693:0:9992:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789127304.648705:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789127304.648739:0:9992:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789127304.648763:0:9992:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd718aadfd785d504 00000100:00080000:0.0:1789127304.648773:0:9992:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127304.648786:0:9992:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9346b7dd0800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789127304.648819:0:9992:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587eba1c0 x1876035789440256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127304.648845:0:9992:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789127304.648905:0:9992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127304.648910:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127304.648912:0:9992:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789127304.648915:0:9992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127304.648919:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127304.648920:0:9992:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789127304.648923:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789127304.648924:0:9992:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789127304.648950:0:9992:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eb92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9992:1876035789440384:0@lo:502: 00000100:00100000:2.0:1789127304.649132:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789440256:0@lo:8: 00000100:00100000:2.0:1789127304.655986:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127304.656296:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789440256 00000100:00100000:1.0:1789127304.656305:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789440256 00000100:00100000:1.0:1789127304.656351:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127304.656359:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3649:x1876035789440256:12345-0@lo:8: 00010000:00080000:1.0:1789127304.656406:0:8438:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:1.0:1789127304.656451:0:8438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd718aadfd785d50b 00002000:00100000:1.0:1789127304.656464:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff934587f7c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113987 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789127304.656468:0:8438:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789127304.656471:0:8438:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789127304.656589:0:8438:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789127304.656615:0:8438:0:(import.c:65:import_set_state_nolock()) ffff934587f7a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127304.656746:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3649:x1876035789440256:12345-0@lo:8: Request processed in 385us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.656753:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789127304.657649:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587eba1c0 x1876035789440256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127304.657664:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127304.657674:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789127304.657682:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789127304.657688:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789127304.657691:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346b7dd0800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789127304.657706:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789127304.657712:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789440256:0@lo:8: 00000004:00080000:2.0:1789127304.659007:0:9993:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789127304.659305:0:9993:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 265851794303ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789127304.659312:0:9993:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1789127304.662201:0:9992:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127304.662343:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789440384 00000100:00100000:1.0:1789127304.662351:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789440384 00000100:00100000:1.0:1789127304.662409:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789127304.662419:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:9992:x1876035789440384:12345-0@lo:502: 00000100:00100000:1.0:1789127304.662580:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:9992:x1876035789440384:12345-0@lo:502: Request processed in 162us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.662587:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000001:00100000:3.0:1789127304.663887:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789127304.663896:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1789127304.664066:0:8447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9990:x1876035789438592:12345-0@lo:700: Request processed in 59133us (61526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.664078:0:8447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789127304.664169:0:9990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345863e4000 x1876035789438592/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789127320 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127304.664184:0:9990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9990:1876035789438592:0@lo:700: 00000100:00100000:0.0:1789127304.665364:0:9992:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b54140c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.665413:0:9992:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eb92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:9992:1876035789440384:0@lo:502: 00000020:01000000:0.0:1789127304.665454:0:9992:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127304.665461:0:9992:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127304.665463:0:9992:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789127304.665468:0:9992:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1789127304.666548:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1789127304.666588:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789127304.666601:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d4ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.666623:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d4ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127304.666633:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789127304.666635:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9346b18f3490 from 1 10000000:01000000:3.0:1789127304.666639:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789127304.666674:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.666682:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.666692:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127304.666713:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789440512:0@lo:101: 00000100:00100000:3.0:1789127304.666775:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.666811:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.668834:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789440512 00000100:00100000:0.0:1789127304.668847:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789440512 00000100:00100000:0.0:1789127304.668905:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789127304.668916:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789440512:12345-0@lo:101: 00010000:00010000:0.0:1789127304.668933:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127304.668950:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346813c8000/0xd718aadfd785d519 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d512 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127304.668976:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346813c8000/0xd718aadfd785d519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d512 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127304.669022:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346813c8000/0xd718aadfd785d519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d512 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127304.669031:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346813c8000, rc 0) 00000100:00100000:0.0:1789127304.669108:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789440512:12345-0@lo:101: Request processed in 194us (2332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.669115:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789127304.669178:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789440512:0@lo:101: 00010000:00010000:3.0:1789127304.669204:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d519 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.669216:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d519 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127304.669283:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789440640:0@lo:501: 00000100:00100000:3.0:1789127304.669311:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.669353:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ad000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127304.669409:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789440640 00000100:00100000:2.0:1789127304.669414:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789440640 00000100:00100000:2.0:1789127304.669481:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789127304.669489:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789440640:12345-0@lo:501: 00000100:00100000:2.0:1789127304.669585:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789440640:12345-0@lo:501: Request processed in 98us (273us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127304.669592:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789127304.669644:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789440640:0@lo:501: 10000000:01000000:3.0:1789127304.669671:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789127304.669676:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d519 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127304.669685:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d519 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789127304.673328:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789127304.673528:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:1.0:1789127304.674005:0:9994:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789127304.674040:0:9994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9994:1876035789440896:0@lo:7: 00000100:00100000:1.0:1789127304.674106:0:9994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127304.674143:0:9994:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5540 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.674198:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789440896 00000100:00100000:0.0:1789127304.674209:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789440896 00000100:00100000:0.0:1789127304.674273:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127304.674284:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9994:x1876035789440896:12345-0@lo:7: 00000100:00080000:1.0:1789127304.677066:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127304.678770:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789440768:0@lo:13: 00000100:00100000:3.0:1789127304.678840:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789127304.678984:0:9990:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789127304.679023:0:9990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9990:1876035789441152:0@lo:7: 00000100:00100000:1.0:1789127304.679036:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789440768 00000100:00100000:0.0:1789127304.679038:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127304.679050:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789440768 00000100:00100000:2.0:1789127304.679060:0:9990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.679098:0:9990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127304.679101:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789127304.679114:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1876035789440768:12345-0@lo:13: 00000100:00100000:2.0:1789127304.679117:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789441152 00000100:00100000:2.0:1789127304.679122:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789441152 00002000:00000024:1.0:1789127304.679140:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923828736 avail 3692306432 00000100:00100000:0.0:1789127304.679161:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789441024:0@lo:13: 00000100:00100000:2.0:1789127304.679168:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127304.679178:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9990:x1876035789441152:12345-0@lo:7: 00000100:00100000:1.0:1789127304.679189:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1876035789440768:12345-0@lo:13: Request processed in 77us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.679192:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127304.679197:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789127304.679211:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789441024 00000100:00100000:1.0:1789127304.679214:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789441024 00000100:00100000:1.0:1789127304.679232:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127304.679237:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1876035789441024:12345-0@lo:13: 00002000:00000024:1.0:1789127304.679245:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923828736 avail 3692306432 00000100:00100000:1.0:1789127304.679285:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1876035789441024:12345-0@lo:13: Request processed in 47us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.679290:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789127304.679412:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346928f6940 x1876035789440768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127304.679433:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789440768:0@lo:13: 00010000:00080000:2.0:1789127304.682320:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345863e4000 x1876035789441024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127320 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127304.682347:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789441024:0@lo:13: 00002000:00080000:0.0:1789127304.683875:0:8755:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789127304.683882:0:8755:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789127304.684457:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9994:x1876035789440896:12345-0@lo:7: Request processed in 10172us (10347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.684467:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789127304.685610:0:9994:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346928f7480 x1876035789440896/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789127320 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127304.685627:0:9994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9994:1876035789440896:0@lo:7: 00000004:00080000:3.0:1789127304.685642:0:9994:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789127304.685682:0:9994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9994:1876035789441280:0@lo:5: 00000100:00100000:3.0:1789127304.685730:0:9994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.685765:0:9994:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.685824:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789441280 00000100:00100000:0.0:1789127304.685831:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789441280 00000100:00100000:0.0:1789127304.685879:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127304.685899:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9994:x1876035789441280:12345-0@lo:5: 00002000:00080000:0.0:1789127304.685924:0:8439:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789127304.685928:0:8439:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789127304.691548:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9994:x1876035789441280:12345-0@lo:5: Request processed in 5655us (5812us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789127304.691570:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789127304.691580:0:9994:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878cf840 x1876035789441280/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127320 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127304.691600:0:9994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9994:1876035789441280:0@lo:5: 00000004:00080000:3.0:1789127304.691635:0:9994:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789127304.691683:0:9994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9994:1876035789441408:0@lo:700: 00000100:00100000:3.0:1789127304.691723:0:9994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127304.691754:0:9994:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ad000 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.691926:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789441408 00000100:00100000:0.0:1789127304.691933:0:8446:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789441408 00000100:00100000:0.0:1789127304.691979:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127304.691987:0:8446:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9994:x1876035789441408:12345-0@lo:700: 00002000:00080000:1.0:1789127304.692577:0:8438:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789127304.692585:0:8438:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789127304.692680:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9990:x1876035789441152:12345-0@lo:7: Request processed in 13503us (13619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.692689:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1789127304.696258:0:9990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345863e5a40 x1876035789441152/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789127320 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127304.696280:0:9990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9990:1876035789441152:0@lo:7: 00000004:00080000:2.0:1789127304.696298:0:9990:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789127304.696341:0:9990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9990:1876035789441536:0@lo:5: 00000100:00100000:2.0:1789127304.696400:0:9990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.696447:0:9990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.696454:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789441536 00000100:00100000:0.0:1789127304.696460:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789441536 00000100:00100000:0.0:1789127304.696543:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127304.696553:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9990:x1876035789441536:12345-0@lo:5: 00002000:00080000:0.0:1789127304.696585:0:8755:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789127304.696631:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9990:x1876035789441536:12345-0@lo:5: Request processed in 80us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127304.696638:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789127304.696737:0:9990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345863e5a40 x1876035789441536/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127320 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127304.696746:0:9990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9990:1876035789441536:0@lo:5: 00000004:00080000:2.0:1789127304.696755:0:9990:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789127304.696778:0:9990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9990:1876035789441664:0@lo:5: 00000100:00100000:2.0:1789127304.696802:0:9990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.696828:0:9990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.698557:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789441664 00000100:00100000:0.0:1789127304.698569:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789441664 00000100:00100000:0.0:1789127304.698621:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789127304.698630:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586046d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9990:x1876035789441664:12345-0@lo:5: 00002000:00080000:0.0:1789127304.698668:0:8439:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000001:00080000:2.0:1789127304.701205:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:1.0:1789127304.701419:0:8446:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9994:x1876035789441408:12345-0@lo:700: Request processed in 9429us (9693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127304.701431:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789127304.701688:0:9994:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878ce940 x1876035789441408/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789127320 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127304.701702:0:9994:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789127304.701720:0:9994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9994:1876035789441408:0@lo:700: 00000100:00100000:0.0:1789127304.702592:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586046d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9990:x1876035789441664:12345-0@lo:5: Request processed in 3962us (5787us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789127304.702602:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789127304.702981:0:9990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345863e5a40 x1876035789441664/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127320 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127304.703007:0:9990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9990:1876035789441664:0@lo:5: 00000004:00080000:2.0:1789127304.703020:0:9990:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789127304.703162:0:9990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586045680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9990:1876035789441792:0@lo:900: 00000100:00100000:2.0:1789127304.703202:0:9990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.703234:0:9990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127304.704158:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789441792 00000100:00100000:2.0:1789127304.704168:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789441792 00000100:00100000:2.0:1789127304.704233:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789127304.704243:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345860452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9990:x1876035789441792:12345-0@lo:900: 00000100:00100000:2.0:1789127304.704312:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345860452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9990:x1876035789441792:12345-0@lo:900: Request processed in 71us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127304.704319:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789127304.704352:0:9990:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934586045680 x1876035789441792/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789127320 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127304.704364:0:9990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586045680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9990:1876035789441792:0@lo:900: 00000004:02000040:3.0:1789127304.711984:0:9994:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:2.0:1789127304.716962:0:9994:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586045680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9994:1876035789441920:0@lo:5: 00000100:00100000:2.0:1789127304.717063:0:9994:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127304.717116:0:9994:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127304.717177:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789441920 00000100:00100000:0.0:1789127304.717184:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789441920 00000100:00100000:0.0:1789127304.717235:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127304.717246:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587839680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9994:x1876035789441920:12345-0@lo:5: 00002000:00080000:2.0:1789127304.727463:0:8755:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1789127304.727484:0:8755:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1789127304.729021:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587839680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9994:x1876035789441920:12345-0@lo:5: Request processed in 11773us (11955us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789127304.729033:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789127304.729172:0:9994:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934586045680 x1876035789441920/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127320 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127304.729189:0:9994:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586045680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9994:1876035789441920:0@lo:5: 00000004:00080000:1.0:1789127304.729206:0:9994:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000100:00100000:0.0:1789127305.016299:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458783ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789442048:0@lo:41: 00000100:00100000:0.0:1789127305.016366:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127305.016545:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789442048 00000100:00100000:1.0:1789127305.016552:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789442048 00000100:00100000:1.0:1789127305.016607:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789127305.016616:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789442048:12345-0@lo:41: 00000004:00000024:1.0:1789127305.016646:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789127305.021567:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789442048:12345-0@lo:41: Request processed in 4941us (5190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127305.021576:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458783ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789442048:0@lo:41: 00000100:00100000:1.0:1789127305.021584:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00010000:0.0:1789127305.145127:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789127305.459749:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1789127305.459768:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1789127305.533646:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127305.533676:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587838f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789442176:0@lo:13: 00000100:00100000:2.0:1789127305.533735:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127305.533789:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789442176 00000100:00100000:2.0:1789127305.533795:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789442176 00000100:00100000:2.0:1789127305.533832:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789127305.533841:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789442176:12345-0@lo:13: 00002000:00000024:2.0:1789127305.533866:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127305.533901:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789442176:12345-0@lo:13: Request processed in 61us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127305.533908:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789127305.533952:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587838f00 x1876035789442176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127305.533970:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587838f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789442176:0@lo:13: 00000100:00100000:1.0:1789127305.541328:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127305.546341:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789442304:0@lo:13: 00000100:00100000:1.0:1789127305.546410:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127305.546569:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789442304 00000100:00100000:2.0:1789127305.546576:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789442304 00000100:00100000:2.0:1789127305.546616:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127305.546625:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789442304:12345-0@lo:13: 00002000:00000024:2.0:1789127305.546649:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127305.546708:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789442304:12345-0@lo:13: Request processed in 84us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127305.546715:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1789127305.546748:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aed10b40 x1876035789442304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127305.546765:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed10b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789442304:0@lo:13: 00010000:00010000:2.0:1789127306.167619:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789127306.304065:0:10044:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789127306.304364:0:10044:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789127307.193367:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789127307.331676:0:10093:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127307.331689:0:10093:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1789127308.215864:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127308.995743:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127308.996156:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771564416 00000100:00100000:1.0:1789127308.996169:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771564416 00000100:00100000:1.0:1789127308.996232:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 184 00000100:00100000:1.0:1789127308.996243:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2398:x1876035771564416:12345-192.168.206.48@tcp:250: 00010000:00080000:1.0:1789127308.996279:0:6517:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 3763f5ac-303c-4f4d-b89b-7863c202d0a8@192.168.206.48@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:1.0:1789127308.996314:0:6517:0:(genops.c:1385:class_connect()) connect: client 3763f5ac-303c-4f4d-b89b-7863c202d0a8, cookie 0xd718aadfd785d520 00000100:00080000:1.0:1789127308.996479:0:6517:0:(import.c:65:import_set_state_nolock()) ffff934587f7b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127308.996628:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+5:2398:x1876035771564416:12345-192.168.206.48@tcp:250: Request processed in 386us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127308.996637:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 184 00000100:00100000:1.0:1789127309.013563:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127309.014186:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771564288 00000100:00100000:2.0:1789127309.014200:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771564288 00000100:00100000:2.0:1789127309.014278:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 185 00000100:00100000:2.0:1789127309.014289:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+5:6159:x1876035771564288:12345-192.168.206.48@tcp:101: 00010000:00010000:2.0:1789127309.014311:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127309.014335:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928fec00/0xd718aadfd785d527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffa7b expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127309.014382:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928fec00/0xd718aadfd785d527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa7b expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127309.014418:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928fec00/0xd718aadfd785d527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa7b expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127309.014430:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fec00, rc 0) 00000100:00100000:2.0:1789127309.014550:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+6:6159:x1876035771564288:12345-192.168.206.48@tcp:101: Request processed in 219us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127309.014559:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 185 00000100:00100000:2.0:1789127309.018886:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127309.022810:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771564544 00000100:00100000:0.0:1789127309.022832:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771564544 00000100:00100000:0.0:1789127309.022921:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 186 00000100:00100000:0.0:1789127309.022934:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+6:6159:x1876035771564544:12345-192.168.206.48@tcp:501: 00000100:00100000:0.0:1789127309.023125:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+6:6159:x1876035771564544:12345-192.168.206.48@tcp:501: Request processed in 193us (4252us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127309.023135:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 186 00000100:00100000:3.0:1789127309.025867:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127309.034140:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771564672 00000100:00100000:1.0:1789127309.034164:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771564672 00000100:00100000:1.0:1789127309.034271:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 187 00000100:00100000:1.0:1789127309.034285:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+6:6159:x1876035771564672:12345-192.168.206.48@tcp:101: 00010000:00010000:1.0:1789127309.034328:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127309.034354:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501a400/0xd718aadfd785d52e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffa82 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.034403:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501a400/0xd718aadfd785d52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa82 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.034416:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501a400/0xd718aadfd785d52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa82 expref: 7 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.034427:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501a400, rc 0) 00000100:00100000:1.0:1789127309.034549:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+7:6159:x1876035771564672:12345-192.168.206.48@tcp:101: Request processed in 267us (8696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127309.034557:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 187 00000100:00100000:1.0:1789127309.037904:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127309.038017:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771564800 00000100:00100000:2.0:1789127309.038030:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771564800 00000100:00100000:2.0:1789127309.038096:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 188 00000100:00100000:2.0:1789127309.038363:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+7:6159:x1876035771564800:12345-192.168.206.48@tcp:501: 00000100:00100000:2.0:1789127309.038635:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+8:6159:x1876035771564800:12345-192.168.206.48@tcp:501: Request processed in 277us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127309.038645:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 188 00000100:00100000:2.0:1789127309.045228:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127309.059859:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771564928 00000100:00100000:0.0:1789127309.059884:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771564928 00000100:00100000:0.0:1789127309.060129:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 189 00000100:00100000:0.0:1789127309.060143:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+8:6159:x1876035771564928:12345-192.168.206.48@tcp:503: 00000100:00100000:0.0:1789127309.060382:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+8:6159:x1876035771564928:12345-192.168.206.48@tcp:503: Request processed in 232us (15158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127309.060393:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 189 00000100:00100000:3.0:1789127309.071277:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127309.072114:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771565056 00000100:00100000:1.0:1789127309.072126:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771565056 00000100:00100000:1.0:1789127309.072199:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 190 00000100:00100000:1.0:1789127309.072209:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934688ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+8:6178:x1876035771565056:12345-192.168.206.48@tcp:502: 00000100:00100000:1.0:1789127309.072361:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934688ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+8:6178:x1876035771565056:12345-192.168.206.48@tcp:502: Request processed in 153us (1093us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127309.072370:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 190 00000100:00100000:1.0:1789127309.145156:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127309.145596:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771565184 00000100:00100000:0.0:1789127309.145607:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771565184 00000100:00100000:0.0:1789127309.145799:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 191 00000100:00100000:0.0:1789127309.145811:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934688ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+8:6178:x1876035771565184:12345-192.168.206.48@tcp:502: 00000100:00100000:0.0:1789127309.146029:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934688ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+8:6178:x1876035771565184:12345-192.168.206.48@tcp:502: Request processed in 219us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127309.146036:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 191 00000100:00100000:0.0:1789127309.160384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127309.160750:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771565312 00000100:00100000:2.0:1789127309.160760:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771565312 00000100:00100000:2.0:1789127309.160818:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 192 00000100:00100000:2.0:1789127309.160829:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+8:6159:x1876035771565312:12345-192.168.206.48@tcp:101: 00010000:00010000:2.0:1789127309.160845:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127309.160863:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928ffe00/0xd718aadfd785d535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffab3 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127309.160892:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928ffe00/0xd718aadfd785d535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffab3 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127309.160922:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928ffe00/0xd718aadfd785d535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffab3 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127309.160931:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ffe00, rc 0) 00000100:00100000:2.0:1789127309.161008:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6159:x1876035771565312:12345-192.168.206.48@tcp:101: Request processed in 180us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127309.161015:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 192 00000100:00100000:3.0:1789127309.165850:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127309.165950:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771565440 00000100:00100000:1.0:1789127309.165960:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771565440 00000100:00100000:1.0:1789127309.166033:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 193 00000100:00100000:1.0:1789127309.166043:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6159:x1876035771565440:12345-192.168.206.48@tcp:256: 20000000:01000000:1.0:1789127309.166085:0:6517:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789127309.166103:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789127309.166107:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789127309.166110:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789127309.166113:0:6517:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789127309.166115:0:6517:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789127309.168410:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6159:x1876035771565440:12345-192.168.206.48@tcp:256: Request processed in 2358us (2559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127309.168423:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 193 00000100:00100000:0.0:1789127309.171453:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127309.171554:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771565568 00000100:00100000:1.0:1789127309.171564:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771565568 00000100:00100000:1.0:1789127309.171621:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 194 00000100:00100000:1.0:1789127309.171630:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6159:x1876035771565568:12345-192.168.206.48@tcp:101: 00010000:00010000:1.0:1789127309.171658:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127309.171675:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501ac00/0xd718aadfd785d53c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffaba expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.171701:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501ac00/0xd718aadfd785d53c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaba expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.171712:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501ac00/0xd718aadfd785d53c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaba expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127309.171720:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501ac00, rc 0) 00000100:00100000:1.0:1789127309.171991:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6159:x1876035771565568:12345-192.168.206.48@tcp:101: Request processed in 361us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127309.171999:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 194 00000100:00100000:0.0:1789127309.178459:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127309.179542:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771565696 00000100:00100000:1.0:1789127309.179554:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771565696 00000100:00100000:1.0:1789127309.179607:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 195 00000100:00100000:1.0:1789127309.179618:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6159:x1876035771565696:12345-192.168.206.48@tcp:501: 00000100:00100000:1.0:1789127309.179834:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6159:x1876035771565696:12345-192.168.206.48@tcp:501: Request processed in 217us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127309.179843:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 195 00000100:00100000:2.0:1789127309.182247:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127309.182483:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771565824 00000100:00100000:1.0:1789127309.182492:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771565824 00000100:00100000:1.0:1789127309.182577:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 196 00000100:00100000:1.0:1789127309.182590:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6159:x1876035771565824:12345-192.168.206.48@tcp:503: 00000100:00100000:1.0:1789127309.182950:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6159:x1876035771565824:12345-192.168.206.48@tcp:503: Request processed in 362us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127309.182960:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 196 00000100:00100000:0.0:1789127309.190601:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127309.190846:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771565952 00000100:00100000:2.0:1789127309.190857:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771565952 00000100:00100000:2.0:1789127309.190912:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 197 00000100:00100000:2.0:1789127309.190924:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6184:x1876035771565952:12345-192.168.206.48@tcp:502: 00000100:00100000:2.0:1789127309.191274:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6184:x1876035771565952:12345-192.168.206.48@tcp:502: Request processed in 352us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127309.191283:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 197 00000100:00100000:2.0:1789127309.194469:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127309.195042:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771566080 00000100:00100000:1.0:1789127309.195052:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771566080 00000100:00100000:1.0:1789127309.195109:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 198 00000100:00100000:1.0:1789127309.195120:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6184:x1876035771566080:12345-192.168.206.48@tcp:502: 00000100:00100000:1.0:1789127309.195362:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6184:x1876035771566080:12345-192.168.206.48@tcp:502: Request processed in 243us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127309.195370:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 198 00000100:00100000:3.0:1789127309.198934:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127309.199764:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771566208 00000100:00100000:0.0:1789127309.199775:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771566208 00000100:00100000:0.0:1789127309.199830:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:0.0:1789127309.199838:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2398:x1876035771566208:12345-192.168.206.48@tcp:38: 00010000:00080000:0.0:1789127309.199867:0:6524:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:0.0:1789127309.199916:0:6524:0:(genops.c:1385:class_connect()) connect: client 2eecd753-97f2-4dc9-9442-17e5ef8fda22, cookie 0xd718aadfd785d543 00000004:00100000:0.0:1789127309.199939:0:6524:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789127309.200160:0:6524:0:(import.c:65:import_set_state_nolock()) ffff9346aec85000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127309.200227:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2398:x1876035771566208:12345-192.168.206.48@tcp:38: Request processed in 388us (1300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127309.200236:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1789127309.207622:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127309.208092:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771566464 00000100:00100000:0.0:1789127309.208103:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771566464 00000100:00100000:0.0:1789127309.208161:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:0.0:1789127309.208171:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1876035771566464:12345-192.168.206.48@tcp:38: 00010000:00080000:0.0:1789127309.208203:0:9447:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp t0 exp 0000000000000000 cur 270 last 0 00000020:00000080:0.0:1789127309.208250:0:9447:0:(genops.c:1385:class_connect()) connect: client 2eecd753-97f2-4dc9-9442-17e5ef8fda22, cookie 0xd718aadfd785d54a 00000004:00100000:0.0:1789127309.208275:0:9447:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789127309.210616:0:9447:0:(import.c:65:import_set_state_nolock()) ffff9346aec86000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127309.212302:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2398:x1876035771566464:12345-192.168.206.48@tcp:38: Request processed in 2797us (3356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127309.212320:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00010000:00010000:2.0:1789127309.240025:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127309.624645:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789442432:0@lo:41: 00000100:00100000:1.0:1789127309.624715:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127309.624927:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789442432 00000100:00100000:0.0:1789127309.624935:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789442432 00000100:00100000:0.0:1789127309.624992:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789127309.625001:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789442432:12345-0@lo:41: 00000004:00000024:0.0:1789127309.625033:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789127309.625083:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789442432:12345-0@lo:41: Request processed in 83us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127309.625090:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789127309.625259:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789442432:0@lo:41: 00000100:00100000:1.0:1789127310.136832:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127310.136858:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789442560:0@lo:13: 00000100:00100000:1.0:1789127310.136943:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127310.137266:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789442688:0@lo:400: 00000100:00100000:0.0:1789127310.137304:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127310.137327:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789443200:0@lo:400: 00000100:00100000:0.0:1789127310.137350:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127310.137368:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789443712:0@lo:400: 00000100:00100000:0.0:1789127310.137389:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127310.137403:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789444224:0@lo:41: 00000100:00100000:0.0:1789127310.137421:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127310.137438:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789127310.137443:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789442816:0@lo:400: 00000100:00100000:0.0:1789127310.137465:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127310.137481:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789443328:0@lo:400: 00000100:00100000:0.0:1789127310.137528:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127310.137550:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345863e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789443840:0@lo:400: 00000100:00100000:0.0:1789127310.137571:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127310.137613:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789443200 00000100:00100000:0.0:1789127310.137620:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789443200 00000100:00100000:0.0:1789127310.137673:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789444224 00000100:00100000:0.0:1789127310.137676:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789444224 00000100:00100000:0.0:1789127310.137691:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789127310.137699:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1876035789443200:12345-0@lo:400: 00000100:00100000:0.0:1789127310.137765:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1876035789443200:12345-0@lo:400: Request processed in 66us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127310.137773:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789127310.137789:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789127310.137795:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7396d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789444224:12345-0@lo:41: 00000004:00000024:0.0:1789127310.137816:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127310.137844:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7396d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789444224:12345-0@lo:41: Request processed in 49us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127310.137850:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789127310.137869:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789442816 00000100:00100000:0.0:1789127310.137873:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789442816 00000100:00100000:0.0:1789127310.137895:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789443328 00000100:00100000:0.0:1789127310.137897:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789443328 00000100:00100000:0.0:1789127310.137912:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789443840 00000100:00100000:0.0:1789127310.137914:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789443840 00000100:00100000:0.0:1789127310.137926:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789127310.137932:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789442816:12345-0@lo:400: 00000100:00100000:0.0:1789127310.137961:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789442816:12345-0@lo:400: Request processed in 29us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127310.138280:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789442560 00000100:00100000:2.0:1789127310.138285:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789442560 00000100:00100000:2.0:1789127310.138321:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127310.138329:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7388f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789442560:12345-0@lo:13: 00002000:00000024:2.0:1789127310.138347:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127310.138382:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7388f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789442560:12345-0@lo:13: Request processed in 55us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127310.138389:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127310.138413:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789443072:0@lo:400: 00000100:00100000:2.0:1789127310.138446:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127310.138460:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789443584:0@lo:400: 00000100:00100000:2.0:1789127310.138497:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127310.138532:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789444096:0@lo:400: 00000100:00100000:2.0:1789127310.138553:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127310.138574:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789127310.138580:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789442944:0@lo:400: 00000100:00100000:2.0:1789127310.138600:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127310.138616:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789443456:0@lo:400: 00000100:00100000:2.0:1789127310.138634:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127310.138658:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789443968:0@lo:400: 00000100:00100000:2.0:1789127310.138677:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127310.138696:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789443712 00000100:00100000:2.0:1789127310.138699:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789443712 00000100:00100000:2.0:1789127310.138723:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789443584 00000100:00100000:2.0:1789127310.138726:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789443584 00000100:00100000:2.0:1789127310.138739:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789444096 00000100:00100000:2.0:1789127310.138741:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789444096 00000100:00100000:2.0:1789127310.138755:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127310.138761:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7395e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789443712:12345-0@lo:400: 00000100:00100000:2.0:1789127310.138792:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7395e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789443712:12345-0@lo:400: Request processed in 31us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127310.138798:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127310.138809:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789127310.138815:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587838780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789443584:12345-0@lo:400: 00000100:00100000:2.0:1789127310.138843:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587838780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789443584:12345-0@lo:400: Request processed in 28us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127310.138855:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789127310.138867:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127310.138874:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789444096:12345-0@lo:400: 00000100:00100000:2.0:1789127310.138901:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789444096:12345-0@lo:400: Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127310.138908:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127310.138926:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789442944 00000100:00100000:2.0:1789127310.138929:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789442944 00000100:00100000:2.0:1789127310.138949:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127310.138955:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587838b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789442944:12345-0@lo:400: 00000100:00100000:2.0:1789127310.139220:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587838b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789442944:12345-0@lo:400: Request processed in 264us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127310.139226:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127310.139264:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789442944:0@lo:400: 00010000:00080000:2.0:1789127310.139276:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587eba1c0 x1876035789443584/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127310.139286:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789443584:0@lo:400: 00010000:00080000:2.0:1789127310.139295:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73912c0 x1876035789444096/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127310.139302:0:3651:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789127310.139315:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789444096:0@lo:400: 00000100:00100000:2.0:1789127310.139336:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789442688 00000100:00100000:2.0:1789127310.139339:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789442688 00000100:00100000:2.0:1789127310.139365:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789127310.139372:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789442688:12345-0@lo:400: 00000100:00100000:2.0:1789127310.139411:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789442688:12345-0@lo:400: Request processed in 40us (2106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127310.139418:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789127310.139465:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789443072 00000100:00100000:2.0:1789127310.139470:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789443072 00000100:00100000:2.0:1789127310.139485:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789443456 00000100:00100000:2.0:1789127310.139487:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789443456 00000100:00100000:2.0:1789127310.139498:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789443968 00000100:00100000:2.0:1789127310.139501:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789443968 00000100:00100000:2.0:1789127310.139533:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789127310.139540:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789443328:12345-0@lo:400: 00000100:00100000:2.0:1789127310.139570:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789443328:12345-0@lo:400: Request processed in 31us (2061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127310.139576:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789127310.139588:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789127310.139594:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789443840:12345-0@lo:400: 00000100:00100000:2.0:1789127310.139618:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789443840:12345-0@lo:400: Request processed in 24us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127310.139624:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789127310.139634:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1789127310.139909:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587eb8780 x1876035789442816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127310.139921:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789442816:0@lo:400: 00010000:00080000:3.0:1789127310.139932:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebb0c0 x1876035789443328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127310.139940:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789443328:0@lo:400: 00010000:00080000:3.0:1789127310.139954:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345863e6940 x1876035789443840/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127310.139962:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345863e6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789443840:0@lo:400: 00000100:00100000:3.0:1789127310.139999:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789442688:0@lo:400: 00000100:00100000:3.0:1789127310.140011:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eba580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789443200:0@lo:400: 00010000:00080000:3.0:1789127310.140022:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587eba940 x1876035789443712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127310.140030:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789443712:0@lo:400: 00000100:00100000:3.0:1789127310.140044:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789444224:0@lo:41: 00000100:00100000:3.0:1789127310.140064:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127310.140072:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789444352:0@lo:13: 00000100:00100000:3.0:1789127310.140104:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127310.140146:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789444352 00000100:00100000:3.0:1789127310.140151:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789444352 00000100:00100000:3.0:1789127310.140179:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789127310.140185:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789444352:12345-0@lo:13: 00002000:00000024:3.0:1789127310.140198:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127310.140231:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789444352:12345-0@lo:13: Request processed in 46us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127310.140237:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789127310.140323:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127310.140329:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789127310.140338:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127310.140339:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789127310.140361:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346928f6940 x1876035789442560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127310.140369:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789127310.140396:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789442560:0@lo:13: 00000100:00100000:2.0:1789127310.140841:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587838f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789443072:12345-0@lo:400: 00000100:00100000:2.0:1789127310.140887:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587838f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789443072:12345-0@lo:400: Request processed in 53us (2440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127310.144581:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789127310.144630:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789127310.145446:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789443456:12345-0@lo:400: 00000100:00100000:0.0:1789127310.145581:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789443456:12345-0@lo:400: Request processed in 943us (6944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127310.145589:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789127310.145611:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789127310.145619:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789443968:12345-0@lo:400: 00000100:00100000:0.0:1789127310.146876:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789443968:12345-0@lo:400: Request processed in 482us (7422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127310.146890:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1789127310.147004:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587eb9a40 x1876035789443456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127310.147019:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789443456:0@lo:400: 00010000:00080000:0.0:1789127310.147032:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7390780 x1876035789443968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127310.147041:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789443968:0@lo:400: 00010000:00080000:0.0:1789127310.147053:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587eb8b40 x1876035789443072/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127310.147061:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789443072:0@lo:400: 00010000:00080000:0.0:1789127310.147460:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878cf840 x1876035789444352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127310.147479:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789444352:0@lo:13: 00000100:00100000:2.0:1789127310.155780:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789127310.206557:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127310.206759:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771566720 00000100:00100000:2.0:1789127310.206768:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771566720 00000100:00100000:2.0:1789127310.206835:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1789127310.206859:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:6159:x1876035771566720:12345-192.168.206.48@tcp:41: 00000004:00000024:2.0:1789127310.206894:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789127310.206958:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:6159:x1876035771566720:12345-192.168.206.48@tcp:41: Request processed in 101us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127310.206979:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00080000:1.0:1789127310.207279:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127310.207638:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127310.209585:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127310.210685:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127310.210796:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771566592 00000100:00100000:1.0:1789127310.210805:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771566592 00000100:00100000:1.0:1789127310.210866:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771566336 00000100:00100000:1.0:1789127310.210869:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771566336 00000100:00100000:1.0:1789127310.210882:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771566848 00000100:00100000:1.0:1789127310.210884:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771566848 00000100:00100000:1.0:1789127310.210899:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:1.0:1789127310.210908:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b738b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:0:x1876035771566592:12345-192.168.206.48@tcp:41: 00000004:00000024:1.0:1789127310.210935:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127310.210946:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1789127310.210959:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:0:x1876035771566336:12345-192.168.206.48@tcp:41: 00000004:00000024:0.0:1789127310.210988:0:9447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789127310.211018:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b738b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:0:x1876035771566592:12345-192.168.206.48@tcp:41: Request processed in 109us (3380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127310.211026:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:1.0:1789127310.211049:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:0.0:1789127310.211050:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:0:x1876035771566336:12345-192.168.206.48@tcp:41: Request processed in 91us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127310.211058:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:6159:x1876035771566848:12345-192.168.206.48@tcp:40: 00000100:00100000:0.0:1789127310.211063:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:1.0:1789127310.211096:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:6159:x1876035771566848:12345-192.168.206.48@tcp:40: Request processed in 39us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127310.211104:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00080000:3.0:1789127310.211277:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127310.216738:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127310.216916:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127310.216960:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127310.217013:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127310.217210:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771566976 00000100:00100000:2.0:1789127310.217219:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771566976 00000100:00100000:2.0:1789127310.217258:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771567104 00000100:00100000:2.0:1789127310.217262:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771567104 00000100:00100000:2.0:1789127310.217279:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1789127310.217287:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1876035771566976:12345-192.168.206.48@tcp:8: 00010000:00080000:2.0:1789127310.217331:0:8755:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:2.0:1789127310.217358:0:8755:0:(genops.c:1385:class_connect()) connect: client 2eecd753-97f2-4dc9-9442-17e5ef8fda22, cookie 0xd718aadfd785d551 00002000:00100000:2.0:1789127310.217369:0:8755:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2eecd753-97f2-4dc9-9442-17e5ef8fda22/ffff934586073000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789127310.217383:0:8755:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789127310.217594:0:8755:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789127310.217625:0:8755:0:(import.c:65:import_set_state_nolock()) ffff934586075000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127310.217701:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2398:x1876035771566976:12345-192.168.206.48@tcp:8: Request processed in 413us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127310.217709:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1789127310.217724:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:2.0:1789127310.217729:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1876035771567104:12345-192.168.206.48@tcp:8: 00010000:00080000:2.0:1789127310.217756:0:8755:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp t0 exp 0000000000000000 cur 271 last 0 00000020:00000080:2.0:1789127310.217771:0:8755:0:(genops.c:1385:class_connect()) connect: client 2eecd753-97f2-4dc9-9442-17e5ef8fda22, cookie 0xd718aadfd785d558 00002000:00100000:2.0:1789127310.217776:0:8755:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2eecd753-97f2-4dc9-9442-17e5ef8fda22/ffff934586070800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1789127310.218118:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771567232 00000100:00100000:0.0:1789127310.218124:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771567232 00000100:00100000:0.0:1789127310.218159:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:0.0:1789127310.218167:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7decb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:6159:x1876035771567232:12345-192.168.206.48@tcp:900: 00000100:00100000:0.0:1789127310.218206:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7decb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:6159:x1876035771567232:12345-192.168.206.48@tcp:900: Request processed in 41us (1290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127310.218213:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1789127310.218696:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771567360 00000100:00100000:1.0:1789127310.218701:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771567360 00000100:00100000:1.0:1789127310.218766:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 200 00000100:00100000:1.0:1789127310.218773:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2401:x1876035771567360:12345-192.168.206.48@tcp:400: 00000100:00100000:1.0:1789127310.218989:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2401:x1876035771567360:12345-192.168.206.48@tcp:400: Request processed in 215us (2026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127310.218997:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 200 00002000:00100000:2.0:1789127310.219163:0:8755:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789127310.220022:0:8755:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789127310.220057:0:8755:0:(import.c:65:import_set_state_nolock()) ffff9346aecbe800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127310.220107:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2398:x1876035771567104:12345-192.168.206.48@tcp:8: Request processed in 2375us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127310.220116:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:0.0:1789127310.233220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127310.233540:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771567488 00000100:00100000:2.0:1789127310.233550:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771567488 00000100:00100000:2.0:1789127310.233599:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:2.0:1789127310.233609:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:6159:x1876035771567488:12345-192.168.206.48@tcp:33: 00000004:00080000:3.0:1789127310.251903:0:6525:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 18194us 00010000:00010000:2.0:1789127310.264170:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:1.0:1789127310.265955:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789127310.266064:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:6159:x1876035771567488:12345-192.168.206.48@tcp:33: Request processed in 32450us (32848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127310.266078:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:3.0:1789127310.503596:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127310.503716:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771567616 00000100:00100000:0.0:1789127310.503726:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771567616 00000100:00100000:0.0:1789127310.503799:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:0.0:1789127310.503811:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7def0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:6202:x1876035771567616:12345-192.168.206.48@tcp:101: 00010000:00010000:0.0:1789127310.503830:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127310.505177:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346813c8400/0xd718aadfd785d55f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffaeb expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127310.505253:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346813c9e00/0xd718aadfd785d566 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127310.505267:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346813c9e00/0xd718aadfd785d566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127310.505282:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346813c9e00/0xd718aadfd785d566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127310.505330:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789127310.505346:0:9447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127310.505365:0:9447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346813c9e00/0xd718aadfd785d566 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127310.505392:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346813c8400/0xd718aadfd785d55f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaeb expref: 8 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127310.505412:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346813c9e00/0xd718aadfd785d566 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaeb expref: 7 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127310.505421:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346a69cb400) 00010000:00010000:0.0:1789127310.505424:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127310.505427:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346813c9e00, rc 0) 00000100:00100000:0.0:1789127310.505489:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7def0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:6202:x1876035771567616:12345-192.168.206.48@tcp:101: Request processed in 1680us (1901us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127310.505498:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1789127310.648732:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7deda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789444480:0@lo:13: 00000100:00100000:1.0:1789127310.648840:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127310.649028:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789444480 00000100:00100000:3.0:1789127310.649036:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789444480 00000100:00100000:3.0:1789127310.649091:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127310.649100:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7388780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789444480:12345-0@lo:13: 00002000:00000024:3.0:1789127310.649123:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127310.649168:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7388780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789444480:12345-0@lo:13: Request processed in 69us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127310.649176:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789127310.649215:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7deda40 x1876035789444480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127310.649232:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7deda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789444480:0@lo:13: 00000100:00100000:3.0:1789127310.649493:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127310.649504:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789444608:0@lo:13: 00000100:00100000:3.0:1789127310.649548:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127310.649720:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789444608 00000100:00100000:0.0:1789127310.649725:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789444608 00000100:00100000:0.0:1789127310.649767:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789127310.649775:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7deda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789444608:12345-0@lo:13: 00002000:00000024:0.0:1789127310.649902:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127310.649946:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7deda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789444608:12345-0@lo:13: Request processed in 172us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127310.649953:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1789127310.650036:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca5e00 x1876035789444608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127310.650052:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789444608:0@lo:13: 00010000:00010000:0.0:1789127311.289530:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127312.312152:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789127312.705132:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000100:00100000:1.0:1789127312.728921:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127312.729084:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771567744 00000100:00100000:3.0:1789127312.729095:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771567744 00000100:00100000:3.0:1789127312.729171:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1789127312.729182:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:6255:x1876035771567744:12345-192.168.206.48@tcp:41: 00000004:00000024:3.0:1789127312.729221:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789127312.729286:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7388000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:6255:x1876035771567744:12345-192.168.206.48@tcp:41: Request processed in 106us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127312.729310:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00080000:1.0:1789127312.729373:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127312.733042:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127312.733188:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771567872 00000100:00100000:0.0:1789127312.733198:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771567872 00000100:00100000:0.0:1789127312.733276:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:0.0:1789127312.733301:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587839a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:6255:x1876035771567872:12345-192.168.206.48@tcp:41: 00000004:00000024:0.0:1789127312.733340:0:9447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127312.733410:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587839a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:6255:x1876035771567872:12345-192.168.206.48@tcp:41: Request processed in 111us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127312.733417:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00080000:1.0:1789127312.733486:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127312.738225:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127312.738320:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771568000 00000100:00100000:1.0:1789127312.738330:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771568000 00000100:00100000:1.0:1789127312.738400:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1789127312.738410:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:6255:x1876035771568000:12345-192.168.206.48@tcp:13: 00002000:00000024:1.0:1789127312.738441:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127312.738536:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:6255:x1876035771568000:12345-192.168.206.48@tcp:13: Request processed in 100us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127312.738544:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00080000:3.0:1789127312.738972:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127312.741193:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127312.741336:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771568128 00000100:00100000:1.0:1789127312.741347:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771568128 00000100:00100000:1.0:1789127312.741416:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:1.0:1789127312.741427:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:6255:x1876035771568128:12345-192.168.206.48@tcp:13: 00002000:00000024:1.0:1789127312.741476:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127312.741575:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dee1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:6255:x1876035771568128:12345-192.168.206.48@tcp:13: Request processed in 148us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127312.741583:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00080000:3.0:1789127312.742111:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789127313.341117:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127314.361033:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127314.746088:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ded2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789444736:0@lo:41: 00000100:00100000:0.0:1789127314.746166:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127314.746624:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789444736 00000100:00100000:3.0:1789127314.746634:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789444736 00000100:00100000:3.0:1789127314.746703:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789127314.746719:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789444736:12345-0@lo:41: 00000004:00000024:3.0:1789127314.746770:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1789127314.747258:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789444736:12345-0@lo:41: Request processed in 544us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127314.747268:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789127314.747458:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ded2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789444736:0@lo:41: 00000001:00100000:1.0:1789127314.748227:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000001:00100000:0.0:1789127314.749472:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000100:00100000:1.0:1789127315.258912:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7388b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789444992:0@lo:13: 00000100:00100000:1.0:1789127315.258992:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127315.259061:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789444992 00000100:00100000:1.0:1789127315.259068:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789444992 00000100:00100000:1.0:1789127315.259120:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789127315.259130:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b738a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789444992:12345-0@lo:13: 00002000:00000024:1.0:1789127315.259158:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127315.259201:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b738a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789444992:12345-0@lo:13: Request processed in 74us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127315.259208:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1789127315.259226:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789127315.259254:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7388b40 x1876035789444992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127315.259272:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7388b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789444992:0@lo:13: 00000100:00100000:3.0:1789127315.259558:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127315.259569:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7defc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789444864:0@lo:41: 00000100:00100000:3.0:1789127315.259610:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127315.259639:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789444864 00000100:00100000:3.0:1789127315.259643:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789444864 00000100:00100000:3.0:1789127315.259672:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789127315.259679:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789444864:12345-0@lo:41: 00000004:00000024:3.0:1789127315.259702:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789127315.259738:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789444864:12345-0@lo:41: Request processed in 58us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127315.259744:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789127315.259777:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7defc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789444864:0@lo:41: 00000100:00100000:1.0:1789127315.260713:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7def840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789445120:0@lo:13: 00000100:00100000:1.0:1789127315.260755:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127315.261718:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789445120 00000100:00100000:3.0:1789127315.261726:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789445120 00000100:00100000:3.0:1789127315.261780:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789127315.261796:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7388b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789445120:12345-0@lo:13: 00002000:00000024:3.0:1789127315.261817:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127315.261867:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7388b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789445120:12345-0@lo:13: Request processed in 74us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127315.261875:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789127315.262454:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789127315.262490:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7def840 x1876035789445120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127315.262532:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7def840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789445120:0@lo:13: 00000100:00100000:1.0:1789127315.263645:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789445376:0@lo:400: 00000100:00100000:1.0:1789127315.263699:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127315.263728:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789445888:0@lo:400: 00000100:00100000:1.0:1789127315.263749:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127315.263765:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7389680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789446400:0@lo:400: 00000100:00100000:1.0:1789127315.263787:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127315.263809:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789127315.263815:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789445248:0@lo:400: 00000100:00100000:1.0:1789127315.263844:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127315.263874:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789445760:0@lo:400: 00000100:00100000:1.0:1789127315.263910:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127315.263930:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789446272:0@lo:400: 00000100:00100000:1.0:1789127315.263966:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127315.263989:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789445376 00000100:00100000:1.0:1789127315.263995:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789445376 00000100:00100000:1.0:1789127315.264028:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789445888 00000100:00100000:1.0:1789127315.264030:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789445888 00000100:00100000:1.0:1789127315.264052:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789446400 00000100:00100000:1.0:1789127315.264054:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789446400 00000100:00100000:1.0:1789127315.264067:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789445760 00000100:00100000:1.0:1789127315.264069:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789445760 00000100:00100000:1.0:1789127315.264080:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789446272 00000100:00100000:1.0:1789127315.264082:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789446272 00000100:00100000:1.0:1789127315.264108:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789127315.264117:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b738ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789445376:12345-0@lo:400: 00000100:00100000:1.0:1789127315.264165:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b738ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789445376:12345-0@lo:400: Request processed in 49us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127315.264180:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789127315.264196:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789127315.264202:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789445888:12345-0@lo:400: 00000100:00100000:1.0:1789127315.264231:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789445888:12345-0@lo:400: Request processed in 29us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127315.264236:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789127315.264247:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789127315.264253:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586045680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789446400:12345-0@lo:400: 00000100:00100000:1.0:1789127315.264278:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586045680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789446400:12345-0@lo:400: Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127315.264283:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789127315.264294:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789127315.264299:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789445760:12345-0@lo:400: 00000100:00100000:1.0:1789127315.264322:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789445760:12345-0@lo:400: Request processed in 23us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127315.264328:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789127315.264339:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789127315.264345:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789446272:12345-0@lo:400: 00000100:00100000:1.0:1789127315.264370:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789446272:12345-0@lo:400: Request processed in 26us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127315.264376:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1789127315.264400:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127315.264404:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127315.264413:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789445632:0@lo:400: 00000100:00100000:1.0:1789127315.264437:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127315.264461:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789446144:0@lo:400: 00000100:00100000:1.0:1789127315.264484:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127315.264503:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789127315.264528:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789445504:0@lo:400: 00000100:00100000:1.0:1789127315.264549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127315.264565:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789446016:0@lo:400: 00000100:00100000:1.0:1789127315.264601:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127315.264625:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789446144 00000100:00100000:1.0:1789127315.264629:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789446144 00000100:00100000:1.0:1789127315.264658:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789446016 00000100:00100000:1.0:1789127315.264661:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789446016 00000100:00100000:1.0:1789127315.264679:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789127315.264686:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789446144:12345-0@lo:400: 00000100:00100000:1.0:1789127315.264719:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789446144:12345-0@lo:400: Request processed in 34us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127315.264725:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789127315.264736:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789127315.264742:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789446016:12345-0@lo:400: 00000100:00100000:1.0:1789127315.264766:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789446016:12345-0@lo:400: Request processed in 25us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127315.264772:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789127315.264788:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789445504 00000100:00100000:1.0:1789127315.264792:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789445504 00000100:00100000:1.0:1789127315.264815:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789127315.264821:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789445504:12345-0@lo:400: 00000100:00100000:1.0:1789127315.264850:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789445504:12345-0@lo:400: Request processed in 30us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127315.264864:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1789127315.264890:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127315.264919:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789445760:0@lo:400: 00000100:00100000:1.0:1789127315.264930:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789446272:0@lo:400: 00000100:00100000:1.0:1789127315.264951:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789445376:0@lo:400: 00010000:00080000:1.0:1789127315.264963:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b738bc00 x1876035789445888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127315.264974:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789445888:0@lo:400: 00010000:00080000:1.0:1789127315.264982:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7389680 x1876035789446400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127315.264991:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7389680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789446400:0@lo:400: 00000100:00100000:1.0:1789127315.265022:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789445504:0@lo:400: 00010000:00080000:1.0:1789127315.265031:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b738b840 x1876035789446016/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127315.265040:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789446016:0@lo:400: 00010000:00080000:1.0:1789127315.265048:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7389e00 x1876035789446144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127315.265056:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789446144:0@lo:400: 00000100:00100000:1.0:1789127315.265071:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789445632 00000100:00100000:1.0:1789127315.265073:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789445632 00000100:00100000:1.0:1789127315.265095:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789127315.265100:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789445632:12345-0@lo:400: 00000100:00100000:1.0:1789127315.265140:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789445632:12345-0@lo:400: Request processed in 39us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127315.265146:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789127315.265171:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789445632:0@lo:400: 00000100:00100000:1.0:1789127315.265200:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789445248 00000100:00100000:1.0:1789127315.265204:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789445248 00000100:00100000:1.0:1789127315.265227:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789127315.265233:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789445248:12345-0@lo:400: 00000100:00100000:1.0:1789127315.265265:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789445248:12345-0@lo:400: Request processed in 32us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127315.265271:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789127315.265302:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789445248:0@lo:400: 00010000:00010000:3.0:1789127315.387008:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127315.459779:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127315.459832:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127315.459925:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771568256 00000100:00100000:0.0:1789127315.459948:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771568256 00000100:00100000:0.0:1789127315.460009:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 202 00000100:00100000:0.0:1789127315.460020:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2402:x1876035771568256:12345-192.168.206.48@tcp:400: 00000100:00100000:0.0:1789127315.460090:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2402:x1876035771568256:12345-192.168.206.48@tcp:400: Request processed in 72us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127315.460097:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 202 00000100:00100000:2.0:1789127315.461133:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127315.461167:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127315.461203:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127315.461227:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771568512 00000100:00100000:2.0:1789127315.461234:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771568512 00000100:00100000:2.0:1789127315.461276:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771568384 00000100:00100000:2.0:1789127315.461279:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771568384 00000100:00100000:2.0:1789127315.461303:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:2.0:1789127315.461313:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771568512:12345-192.168.206.48@tcp:400: 00000100:00100000:2.0:1789127315.461365:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771568512:12345-192.168.206.48@tcp:400: Request processed in 54us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127315.461384:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:2.0:1789127315.461400:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:2.0:1789127315.461406:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771568384:12345-192.168.206.48@tcp:400: 00000100:00100000:2.0:1789127315.461431:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771568384:12345-192.168.206.48@tcp:400: Request processed in 25us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127315.461437:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:2.0:1789127315.461454:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771568768 00000100:00100000:2.0:1789127315.461457:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771568768 00000100:00100000:2.0:1789127315.461481:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771568640 00000100:00100000:2.0:1789127315.461484:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771568640 00000100:00100000:2.0:1789127315.461503:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1789127315.461538:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771568768:12345-192.168.206.48@tcp:400: 00000100:00100000:2.0:1789127315.461562:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771568768:12345-192.168.206.48@tcp:400: Request processed in 54us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127315.461568:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1789127315.461579:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:2.0:1789127315.461584:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771568640:12345-192.168.206.48@tcp:400: 00000100:00100000:2.0:1789127315.461603:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771568640:12345-192.168.206.48@tcp:400: Request processed in 19us (401us total) trans 0 rc 0/0 00000100:00080000:0.0:1789127315.462753:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127315.462760:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127315.462762:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127315.462765:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127315.463534:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000001:02000400:2.0:1789127315.590438:0:10191:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1789127315.774620:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789446528:0@lo:13: 00000100:00100000:1.0:1789127315.774694:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127315.774765:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789446528 00000100:00100000:1.0:1789127315.774774:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789446528 00000100:00100000:1.0:1789127315.774814:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789127315.774823:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789446528:12345-0@lo:13: 00002000:00000024:1.0:1789127315.774848:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127315.774900:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789446528:12345-0@lo:13: Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127315.774907:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789127315.774932:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7defc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789446656:0@lo:13: 00000100:00100000:1.0:1789127315.774968:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789127315.775020:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ee70c0 x1876035789446528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127315.775048:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789446528:0@lo:13: 00000100:00100000:3.0:1789127315.775058:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789446656 00000100:00100000:3.0:1789127315.775062:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789446656 00000100:00100000:3.0:1789127315.775103:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789127315.775110:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789446656:12345-0@lo:13: 00002000:00000024:3.0:1789127315.775120:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127315.775155:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789446656:12345-0@lo:13: Request processed in 46us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127315.775162:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789127315.775185:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7defc00 x1876035789446656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127315.775197:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7defc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789446656:0@lo:13: 00000001:00100000:1.0:1789127315.782189:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2eecd753-97f2-4dc9-9442-17e5ef8fda22 00010000:00010000:2.0:1789127316.407636:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127317.432745:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127318.455889:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789127318.918197:0:10338:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd338849f0 20000000:00000080:1.0:1789127318.918214:0:10338:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9346c1e90000 uarg=0000000000000000 20000000:01000000:1.0:1789127318.918265:0:10338:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789127318.918267:0:10338:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789127318.918270:0:10338:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789127318.918275:0:10338:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1789127318.918280:0:10338:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1789127318.918334:0:10338:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789127318.918336:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789127318.919201:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1789127318.919444:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1789127318.920158:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1789127318.920180:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1789127318.920190:0:10338:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789127318.920193:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789127318.920939:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1789127318.921233:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1789127318.921260:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1789127318.921279:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1789127318.921288:0:10338:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789127318.921290:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789127318.922179:0:10341:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1789127318.922363:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1789127318.922387:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1789127318.922401:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:1.0:1789127318.922411:0:10338:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789127318.922413:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789127318.923393:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1789127318.924250:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1789127318.924279:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1789127318.924293:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1789127318.924310:0:10338:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789127318.924312:0:10338:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1789127318.925229:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1789127318.925426:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1789127318.925449:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1789127318.925701:0:10338:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 10000000:01000000:1.0:1789127318.925932:0:10338:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789127318.925954:0:10338:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.925971:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d408 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d401 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.925978:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346c214d800/0xd718aadfd785d432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d42b expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.925985:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d471 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d46a expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.925991:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93469a7a0400/0xd718aadfd785d47f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d478 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.926084:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346c214c600/0xd718aadfd785d48d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d486 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.926091:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928fea00/0xd718aadfd785d4a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d4a2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.926099:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346813c9800/0xd718aadfd785d4d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d4cc expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.926105:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346c214dc00/0xd718aadfd785d4ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d4e8 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.926126:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346813c8000/0xd718aadfd785d519 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d512 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.926136:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928fec00/0xd718aadfd785d527 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa7b expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.926144:0:10338:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93468501a400/0xd718aadfd785d52e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa82 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.926151:0:10338:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.926193:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93468501a400/0xd718aadfd785d52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa82 expref: 9 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.926210:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93468501a400/0xd718aadfd785d52e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa82 expref: 9 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.926226:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789446784:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127318.926389:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928fec00/0xd718aadfd785d527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa7b expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.926398:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9346928fec00/0xd718aadfd785d527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa7b expref: 9 pid: 6516 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.926406:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789446912:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127318.926438:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346813c8000/0xd718aadfd785d519 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d512 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.926456:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346813c8000/0xd718aadfd785d519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d512 expref: 23 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.926476:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789447040:0@lo:104: 00000100:00100000:1.0:1789127318.926556:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127318.926593:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346c214dc00/0xd718aadfd785d4ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d4e8 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.926601:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346c214dc00/0xd718aadfd785d4ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d4e8 expref: 23 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.926609:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789447168:0@lo:104: 00000100:00100000:1.0:1789127318.926630:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127318.926657:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346813c9800/0xd718aadfd785d4d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d4cc expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.926665:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346813c9800/0xd718aadfd785d4d3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d4cc expref: 23 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.926673:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789447296:0@lo:104: 00000100:00100000:1.0:1789127318.926693:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127318.926733:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789447040 00000100:00100000:1.0:1789127318.926740:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789447040 00000100:00100000:3.0:1789127318.926885:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789447168 00000100:00100000:3.0:1789127318.926890:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789447168 00000100:00100000:3.0:1789127318.926910:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789447296 00000100:00100000:3.0:1789127318.926912:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789447296 00000100:00100000:3.0:1789127318.926937:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127318.926947:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:10338:x1876035789447040:12345-0@lo:104: 00010000:00010000:3.0:1789127318.926960:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d519 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927027:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127318.927033:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:10338:x1876035789447040:12345-0@lo:104: Request processed in 89us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127318.927039:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127318.927057:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789127318.927063:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:10338:x1876035789447168:12345-0@lo:104: 00010000:00010000:3.0:1789127318.927071:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d4ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927104:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789127318.927109:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:10338:x1876035789447168:12345-0@lo:104: Request processed in 47us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127318.927115:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789127318.927127:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127318.927133:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:10338:x1876035789447296:12345-0@lo:104: 00010000:00010000:3.0:1789127318.927140:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d4d3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927169:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789127318.927173:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:10338:x1876035789447296:12345-0@lo:104: Request processed in 42us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127318.927179:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1789127318.927193:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789127318.927199:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d519 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927216:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0600 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:3.0:1789127318.927220:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d519 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927229:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d519 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127318.927236:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d519 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127318.927242:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127318.927267:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d519 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927273:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127318.927288:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d519 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927296:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d512 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d519 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927313:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127318.927316:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d4ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927321:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214ce00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:3.0:1789127318.927324:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d4ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927340:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d4ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127318.927347:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d4ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127318.927353:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127318.927363:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d4ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927367:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127318.927372:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d4ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927379:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346c214ce00/0xd718aadfd785d4e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d4ef expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927388:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127318.927390:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d4d3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927396:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff400 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:3.0:1789127318.927399:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d4d3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927406:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d4d3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127318.927412:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d4d3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127318.927421:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789127318.927431:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d4d3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927436:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789127318.927455:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d4d3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927462:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928ff400/0xd718aadfd785d4cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d4d3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927471:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127318.927472:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127318.927474:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127318.927479:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127318.927496:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ded680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789447552:0@lo:103: 00000100:00100000:3.0:1789127318.927546:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127318.927567:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127318.927572:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789447424:0@lo:103: 00000100:00100000:3.0:1789127318.927588:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127318.927606:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7deed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789447680:0@lo:103: 00000100:00100000:3.0:1789127318.927624:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127318.927655:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789447552 00000100:00100000:3.0:1789127318.927659:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789447552 00010000:00010000:3.0:1789127318.927676:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346c214dc00/0xd718aadfd785d4ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d4e8 expref: 24 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127318.927692:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789447424 00000100:00100000:3.0:1789127318.927699:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789447424 00010000:00010000:3.0:1789127318.927710:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346813c8000/0xd718aadfd785d519 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d512 expref: 25 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127318.927719:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789447680 00000100:00100000:3.0:1789127318.927721:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789447680 00010000:00010000:3.0:1789127318.927728:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346813c9800/0xd718aadfd785d4d3 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d4cc expref: 26 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127318.927739:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127318.927744:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+26:3653:x1876035789447552:12345-0@lo:103: 00010000:00010000:3.0:1789127318.927753:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127318.927757:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346c214dc00/0xd718aadfd785d4ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d4e8 expref: 26 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.927990:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346c214dc00/0xd718aadfd785d4ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d4e8 expref: 26 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.928021:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127318.928055:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9dedc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+26:3653:x1876035789447552:12345-0@lo:103: Request processed in 310us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127318.928063:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127318.928097:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789127318.928103:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7decf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+25:3653:x1876035789447424:12345-0@lo:103: 00010000:00010000:3.0:1789127318.928110:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127318.928114:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346813c8000/0xd718aadfd785d519 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d512 expref: 25 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.928123:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346813c8000/0xd718aadfd785d519 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d512 expref: 25 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.928142:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127318.928161:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7decf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+25:3653:x1876035789447424:12345-0@lo:103: Request processed in 58us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127318.928167:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789127318.928178:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127318.928183:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789447680:12345-0@lo:103: 00010000:00010000:3.0:1789127318.928190:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127318.928194:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346813c9800/0xd718aadfd785d4d3 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d4cc expref: 24 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.928202:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346813c9800/0xd718aadfd785d4d3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d4cc expref: 24 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.928210:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127318.928228:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7def480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789447680:12345-0@lo:103: Request processed in 45us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127318.928234:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127318.928260:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7deed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789447680:0@lo:103: 00000100:00100000:3.0:1789127318.928279:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789447424:0@lo:103: 00000100:00100000:3.0:1789127318.928285:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ded680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789447552:0@lo:103: 00010000:00010000:1.0:1789127318.928481:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928fea00/0xd718aadfd785d4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d4a2 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.928491:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928fea00/0xd718aadfd785d4a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d4a2 expref: 23 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.928536:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789447808:0@lo:104: 00000100:00100000:1.0:1789127318.928564:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127318.928592:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346c214c600/0xd718aadfd785d48d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d486 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.928600:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346c214c600/0xd718aadfd785d48d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d486 expref: 23 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.928609:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789447936:0@lo:104: 00010000:00010000:1.0:1789127318.928630:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93469a7a0400/0xd718aadfd785d47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d478 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.928637:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93469a7a0400/0xd718aadfd785d47f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d478 expref: 23 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.928645:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73892c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789448064:0@lo:104: 00010000:00010000:1.0:1789127318.928675:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d46a expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.928683:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d46a expref: 23 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.928691:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7389e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789448192:0@lo:104: 00000100:00100000:2.0:1789127318.929074:0:9528:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789127318.929095:0:9528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127318.929115:0:9528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127318.929132:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789447808 00000100:00100000:2.0:1789127318.929137:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789447808 00000100:00100000:2.0:1789127318.929165:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789447936 00000100:00100000:2.0:1789127318.929167:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789447936 00000100:00100000:2.0:1789127318.929174:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789448064 00000100:00100000:2.0:1789127318.929176:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789448064 00000100:00100000:2.0:1789127318.929186:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789127318.929193:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed17050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:10338:x1876035789447808:12345-0@lo:104: 00010000:00010000:2.0:1789127318.929204:0:9528:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d4a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929246:0:9528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789127318.929251:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed17050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:10338:x1876035789447808:12345-0@lo:104: Request processed in 60us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127318.929257:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789127318.929285:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789127318.929290:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587839e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:10338:x1876035789447936:12345-0@lo:104: 00010000:00010000:2.0:1789127318.929297:0:9528:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d48d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929325:0:9528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789127318.929329:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587839e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:10338:x1876035789447936:12345-0@lo:104: Request processed in 39us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127318.929335:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789127318.929345:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789127318.929351:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:10338:x1876035789448064:12345-0@lo:104: 00010000:00010000:2.0:1789127318.929358:0:9528:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d47f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929395:0:9528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789127318.929399:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:10338:x1876035789448064:12345-0@lo:104: Request processed in 49us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127318.929405:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1789127318.929422:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789127318.929427:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d4a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929433:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0e00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127318.929437:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d4a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929446:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d4a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127318.929452:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d4a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127318.929458:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127318.929496:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d4a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929502:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127318.929540:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d4a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929547:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a0e00/0xd718aadfd785d4a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d4a9 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929568:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127318.929572:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d48d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929578:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1c00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127318.929580:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d48d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929587:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d48d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127318.929593:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d48d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127318.929598:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127318.929612:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d48d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929617:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127318.929628:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d48d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929634:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d486 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d48d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929643:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127318.929646:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d47f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929662:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0a00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127318.929665:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d47f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.929671:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d47f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127318.929677:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d47f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127318.929682:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789127318.929954:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127318.929990:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346c214d800/0xd718aadfd785d432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d42b expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127318.930116:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789448192 00000100:00100000:3.0:1789127318.930121:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789448192 00000100:00100000:3.0:1789127318.930142:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127318.930149:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b738b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:10338:x1876035789448192:12345-0@lo:104: 00010000:00010000:3.0:1789127318.930157:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d471 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.930190:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127318.930195:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b738b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:10338:x1876035789448192:12345-0@lo:104: Request processed in 47us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127318.930201:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00010000:1.0:1789127318.930241:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346c214d800/0xd718aadfd785d432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d42b expref: 23 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.930257:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789448704:0@lo:104: 00000100:00100000:1.0:1789127318.930279:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127318.930307:0:10338:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d401 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.930316:0:10338:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d401 expref: 23 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.930324:0:10338:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789448832:0@lo:104: 00000100:00100000:1.0:1789127318.930340:0:10338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127318.930349:0:10338:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aed09540 going to sleep for 11 seconds 00010000:00010000:1.0:1789127318.930366:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346813c8000/0xd718aadfd785d519 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d512 expref: 23 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.930378:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789447040:0@lo:104: 00010000:00010000:1.0:1789127318.930389:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346c214dc00/0xd718aadfd785d4ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d4e8 expref: 22 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.930397:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789447168:0@lo:104: 00010000:00010000:1.0:1789127318.930407:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346813c9800/0xd718aadfd785d4d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d4cc expref: 21 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.930416:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789447296:0@lo:104: 00000100:00100000:1.0:1789127318.930424:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee6580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789447808:0@lo:104: 00000100:00100000:1.0:1789127318.930430:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789447936:0@lo:104: 00000100:00100000:1.0:1789127318.930438:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73892c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789448064:0@lo:104: 00000100:00100000:1.0:1789127318.930456:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7389e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789448192:0@lo:104: 00000100:00100000:3.0:1789127318.930598:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789448704 00000100:00100000:3.0:1789127318.930603:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789448704 00000100:00100000:3.0:1789127318.930619:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789448832 00000100:00100000:3.0:1789127318.930621:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789448832 00000100:00100000:3.0:1789127318.930631:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127318.930636:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7389680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:10338:x1876035789448704:12345-0@lo:104: 00010000:00010000:3.0:1789127318.930644:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d432 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.930680:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789127318.930686:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7389680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:10338:x1876035789448704:12345-0@lo:104: Request processed in 49us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127318.930692:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127318.930717:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127318.930723:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7389a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:10338:x1876035789448832:12345-0@lo:104: 00010000:00010000:3.0:1789127318.930730:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d408 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127318.930755:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789127318.930759:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7389a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:10338:x1876035789448832:12345-0@lo:104: Request processed in 38us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127318.930765:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789127318.931264:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789448704:0@lo:104: 00000100:00100000:1.0:1789127318.931272:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789448832:0@lo:104: 00010000:00010000:2.0:1789127318.931314:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d47f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.931323:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127318.931335:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d47f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.931342:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d478 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d47f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.931354:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789127318.931358:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d471 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.931364:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346813c9c00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127318.931368:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d471 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.931387:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d471 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127318.931394:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d471 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127318.931401:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127318.931460:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d471 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.931475:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127318.931481:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d471 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.931488:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346813c9c00/0xd718aadfd785d46a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d471 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.931498:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127318.931501:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d432 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.931526:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fee00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127318.931529:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d432 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.931536:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d432 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127318.931543:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d432 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127318.931553:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127318.931981:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d432 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.931988:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127318.931993:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d432 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.932158:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d42b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d432 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.932176:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127318.932179:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d408 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.932185:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe400 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127318.932188:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d408 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.932194:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d408 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127318.932202:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d408 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127318.932207:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789127318.932269:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d408 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.932276:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127318.932284:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d408 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.932290:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d401 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d408 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.932302:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127318.932304:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127318.932306:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127318.932322:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789448448:0@lo:103: 00000100:00100000:2.0:1789127318.932371:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127318.932440:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789449216:0@lo:103: 00000100:00100000:2.0:1789127318.932459:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127318.932723:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127318.932730:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789448576:0@lo:103: 00000100:00100000:2.0:1789127318.932754:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127318.933080:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789448448 00000100:00100000:1.0:1789127318.933087:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789448448 00010000:00010000:1.0:1789127318.933115:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346c214c600/0xd718aadfd785d48d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d486 expref: 21 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.933135:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789449216 00000100:00100000:1.0:1789127318.933137:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789449216 00010000:00010000:1.0:1789127318.933146:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d401 expref: 22 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.933158:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789127318.933164:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:3652:x1876035789448448:12345-0@lo:103: 00010000:00010000:1.0:1789127318.933175:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127318.933180:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346c214c600/0xd718aadfd785d48d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d486 expref: 22 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.933189:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346c214c600/0xd718aadfd785d48d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d486 expref: 22 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.933203:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346c214c600/0xd718aadfd785d48d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d486 expref: 22 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.933217:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127318.933245:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3652:x1876035789448448:12345-0@lo:103: Request processed in 80us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127318.933252:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789127318.933273:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789127318.933279:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:3652:x1876035789449216:12345-0@lo:103: 00010000:00010000:1.0:1789127318.933285:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127318.933290:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d408 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d401 expref: 20 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.933298:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d408 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d401 expref: 20 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.933308:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93469a7a0800/0xd718aadfd785d408 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d401 expref: 20 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.933316:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127318.933334:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:3652:x1876035789449216:12345-0@lo:103: Request processed in 55us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127318.933338:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789127318.933422:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789448448:0@lo:103: 00000100:00100000:2.0:1789127318.933434:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789449216:0@lo:103: 00000100:00100000:2.0:1789127318.933474:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789448576 00000100:00100000:2.0:1789127318.933477:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789448576 00010000:00010000:2.0:1789127318.933492:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93469a7a0400/0xd718aadfd785d47f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d478 expref: 19 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127318.933540:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789127318.933546:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:3652:x1876035789448576:12345-0@lo:103: 00010000:00010000:2.0:1789127318.933555:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127318.933558:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93469a7a0400/0xd718aadfd785d47f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d478 expref: 19 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.933571:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93469a7a0400/0xd718aadfd785d47f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d478 expref: 19 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.933581:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93469a7a0400/0xd718aadfd785d47f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d478 expref: 19 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.933590:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127318.933621:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eba940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:3652:x1876035789448576:12345-0@lo:103: Request processed in 76us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127318.933627:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789127318.933813:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789448576:0@lo:103: 00000100:00100000:2.0:1789127318.934153:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458783ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789448320:0@lo:103: 00000100:00100000:2.0:1789127318.934184:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127318.934210:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789449088:0@lo:103: 00000100:00100000:2.0:1789127318.934228:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127318.934244:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127318.934249:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789448960:0@lo:103: 00000100:00100000:2.0:1789127318.934264:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127318.934279:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127318.934286:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789448320 00000100:00100000:2.0:1789127318.934290:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789448320 00010000:00010000:2.0:1789127318.934304:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928fea00/0xd718aadfd785d4a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d4a2 expref: 18 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127318.934318:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789449088 00000100:00100000:2.0:1789127318.934320:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789449088 00010000:00010000:2.0:1789127318.934328:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346c214d800/0xd718aadfd785d432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d42b expref: 19 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127318.934348:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789448960 00000100:00100000:2.0:1789127318.934351:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789448960 00010000:00010000:2.0:1789127318.934359:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d46a expref: 20 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127318.934369:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127318.934375:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:3651:x1876035789448320:12345-0@lo:103: 00010000:00010000:2.0:1789127318.934384:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127318.934387:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928fea00/0xd718aadfd785d4a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d4a2 expref: 20 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.934395:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928fea00/0xd718aadfd785d4a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d4a2 expref: 20 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.934406:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928fea00/0xd718aadfd785d4a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d4a2 expref: 20 pid: 6517 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.934416:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127318.934447:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eba580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:3651:x1876035789448320:12345-0@lo:103: Request processed in 71us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127318.934453:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127318.934477:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127318.934484:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9de9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:3651:x1876035789449088:12345-0@lo:103: 00010000:00010000:2.0:1789127318.934491:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127318.934496:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346c214d800/0xd718aadfd785d432 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d42b expref: 18 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.934503:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346c214d800/0xd718aadfd785d432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d42b expref: 18 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.934546:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346c214d800/0xd718aadfd785d432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d42b expref: 18 pid: 6516 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.934555:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127318.934577:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9de9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:3651:x1876035789449088:12345-0@lo:103: Request processed in 95us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127318.934583:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127318.934613:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789127318.934619:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:3651:x1876035789448960:12345-0@lo:103: 00010000:00010000:2.0:1789127318.934626:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127318.934630:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d471 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d46a expref: 16 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.934637:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d471 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d46a expref: 16 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.934646:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d471 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d46a expref: 16 pid: 6514 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127318.934653:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127318.934673:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:3651:x1876035789448960:12345-0@lo:103: Request processed in 54us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127318.934677:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789127318.935091:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789448960:0@lo:103: 00000100:00100000:2.0:1789127318.935100:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458783ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789448320:0@lo:103: 00000100:00100000:2.0:1789127318.935106:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789449088:0@lo:103: 00010000:00010000:2.0:1789127318.935139:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127318.939347:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127318.939389:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127318.939447:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771568896 00000100:00100000:0.0:1789127318.939457:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771568896 00010000:00010000:0.0:1789127318.939497:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93468501a400/0xd718aadfd785d52e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa82 expref: 10 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127318.939562:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771569024 00000100:00100000:0.0:1789127318.939567:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771569024 00010000:00010000:0.0:1789127318.939582:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928fec00/0xd718aadfd785d527 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa7b expref: 11 pid: 6516 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127318.939601:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:0.0:1789127318.939618:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:2402:x1876035771568896:12345-192.168.206.48@tcp:103: 00010000:00010000:0.0:1789127318.939632:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127318.939637:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93468501a400/0xd718aadfd785d52e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa82 expref: 11 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127318.939649:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93468501a400/0xd718aadfd785d52e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa82 expref: 11 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127318.939669:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127318.939727:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:2402:x1876035771568896:12345-192.168.206.48@tcp:103: Request processed in 110us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127318.939734:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:0.0:1789127318.939751:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:0.0:1789127318.939758:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2401:x1876035771569024:12345-192.168.206.48@tcp:103: 00010000:00010000:0.0:1789127318.939765:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127318.939782:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928fec00/0xd718aadfd785d527 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa7b expref: 10 pid: 6516 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127318.939791:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928fec00/0xd718aadfd785d527 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa7b expref: 10 pid: 6516 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127318.939814:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127318.939823:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127318.939837:0:6508:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127318.939845:0:6508:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127318.940096:0:6508:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127318.940105:0:6508:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127318.940112:0:6508:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501be00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127318.940116:0:6508:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127318.940124:0:6508:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127318.940134:0:6508:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127318.940144:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127318.940166:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2401:x1876035771569024:12345-192.168.206.48@tcp:103: Request processed in 408us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127318.940180:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00010000:00010000:1.0:1789127318.941579:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501a400/0xd718aadfd785d52e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa82 expref: 9 pid: 6517 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.941597:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee52c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789446784:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127318.941610:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928fec00/0xd718aadfd785d527 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffa7b expref: 8 pid: 6516 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127318.941618:0:10338:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee6940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10338:1876035789446912:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127318.941664:0:10338:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.941674:0:10338:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.941709:0:10338:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127318.941715:0:10338:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501be00/0xd718aadfd785d56d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10338 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127319.479677:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127319.863900:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7defc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789449344:0@lo:41: 00000100:00100000:2.0:1789127319.863982:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127319.864167:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789449344 00000100:00100000:3.0:1789127319.864187:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789449344 00000100:00100000:3.0:1789127319.864239:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789127319.864250:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789449344:12345-0@lo:41: 00000004:00000024:3.0:1789127319.864293:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789127319.864349:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789449344:12345-0@lo:41: Request processed in 101us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127319.864358:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789127319.864715:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7defc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789449344:0@lo:41: 10000000:01000000:3.0:1789127320.055631:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789127320.055639:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff934586ebc000 from 48 10000000:01000000:3.0:1789127320.055644:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789127320.055686:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.055696:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.055706:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127320.055728:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ded680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789449472:0@lo:101: 00000100:00100000:3.0:1789127320.055797:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.055849:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d253c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.056072:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789449472 00000100:00100000:1.0:1789127320.056080:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789449472 00000100:00100000:1.0:1789127320.056137:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1789127320.056146:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+15:6520:x1876035789449472:12345-0@lo:101: 00010000:00010000:1.0:1789127320.056159:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127320.056172:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501a400/0xd718aadfd785d57b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d574 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.056194:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501a400/0xd718aadfd785d57b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d574 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.056203:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501a400/0xd718aadfd785d57b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d574 expref: 16 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.056211:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501a400, rc 0) 00000100:00100000:1.0:1789127320.056262:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789449472:12345-0@lo:101: Request processed in 117us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.056269:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789127320.056359:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ded680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789449472:0@lo:101: 00010000:00010000:3.0:1789127320.056374:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d57b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.056397:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d57b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127320.056454:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ded680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789449600:0@lo:501: 00000100:00100000:3.0:1789127320.056529:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.056559:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d253c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.056779:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789449600 00000100:00100000:0.0:1789127320.056785:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789449600 00000100:00100000:0.0:1789127320.056825:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789127320.056833:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789449600:12345-0@lo:501: 00000100:00100000:0.0:1789127320.056962:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789449600:12345-0@lo:501: Request processed in 130us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.056970:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789127320.057666:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ded680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789449600:0@lo:501: 00000100:00100000:3.0:1789127320.057702:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ded680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789449728:0@lo:503: 00000100:00100000:3.0:1789127320.057752:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.057786:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d253c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.057844:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789449728 00000100:00100000:0.0:1789127320.057849:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789449728 00000100:00100000:0.0:1789127320.057888:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789127320.057896:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789449728:12345-0@lo:503: 00000100:00100000:0.0:1789127320.058002:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789449728:12345-0@lo:503: Request processed in 106us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.058009:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1789127320.058129:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ded680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789449728:0@lo:503: 00000100:00100000:2.0:1789127320.070767:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eba580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10355:1876035789449856:0@lo:502: 00000100:00100000:2.0:1789127320.070866:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.070920:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.071046:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789449856 00000100:00100000:1.0:1789127320.071053:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789449856 00000100:00100000:1.0:1789127320.071104:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789127320.071121:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:10355:x1876035789449856:12345-0@lo:502: 00000100:00100000:1.0:1789127320.071242:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:10355:x1876035789449856:12345-0@lo:502: Request processed in 122us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.071250:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789127320.071363:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eba580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10355:1876035789449856:0@lo:502: 00000100:00100000:2.0:1789127320.071961:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eba580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10355:1876035789449984:0@lo:502: 00000100:00100000:2.0:1789127320.072003:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.072071:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.075611:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789449984 00000100:00100000:1.0:1789127320.075624:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789449984 00000100:00100000:1.0:1789127320.075693:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789127320.075703:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:10355:x1876035789449984:12345-0@lo:502: 00000100:00100000:1.0:1789127320.077248:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:10355:x1876035789449984:12345-0@lo:502: Request processed in 1540us (5238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.077260:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789127320.079667:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eba580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10355:1876035789449984:0@lo:502: 00000040:00080000:2.0:1789127320.079716:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789127320.084863:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789127320.084903:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127320.084925:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d57b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.084936:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d57b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127320.084946:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789127320.084949:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789127320.084952:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789127320.084990:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.084999:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.085008:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127320.085030:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ded680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789450112:0@lo:101: 00000100:00100000:3.0:1789127320.085112:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.085147:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d253c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.085218:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789450112 00000100:00100000:0.0:1789127320.085226:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789450112 00000100:00100000:0.0:1789127320.085275:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789127320.085284:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+16:6520:x1876035789450112:12345-0@lo:101: 00010000:00010000:0.0:1789127320.085296:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127320.085309:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fed400/0xd718aadfd785d589 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d582 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.085331:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fed400/0xd718aadfd785d589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d582 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.085341:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fed400/0xd718aadfd785d589 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d582 expref: 17 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.085356:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fed400, rc 0) 00000100:00100000:0.0:1789127320.085419:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789450112:12345-0@lo:101: Request processed in 135us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.085425:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789127320.085552:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ded680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789450112:0@lo:101: 00010000:00010000:1.0:1789127320.085567:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.085576:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127320.085629:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789450240:0@lo:501: 00000100:00100000:1.0:1789127320.085656:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127320.085674:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec11f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127320.085745:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789450240 00000100:00100000:2.0:1789127320.085750:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789450240 00000100:00100000:2.0:1789127320.085773:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789127320.085780:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789450240:12345-0@lo:501: 00000100:00100000:2.0:1789127320.085899:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789450240:12345-0@lo:501: Request processed in 119us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.085907:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789127320.086114:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789450240:0@lo:501: 00000100:00100000:1.0:1789127320.086142:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789450368:0@lo:503: 00000100:00100000:1.0:1789127320.086179:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127320.086207:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec11f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127320.086250:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789450368 00000100:00100000:2.0:1789127320.086255:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789450368 00000100:00100000:2.0:1789127320.086273:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789127320.086279:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789450368:12345-0@lo:503: 00000100:00100000:2.0:1789127320.086366:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789450368:12345-0@lo:503: Request processed in 86us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.086373:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789127320.086686:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789450368:0@lo:503: 00000100:00100000:1.0:1789127320.087090:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10356:1876035789450496:0@lo:502: 00000100:00100000:1.0:1789127320.087132:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127320.087161:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec116c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127320.087207:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789450496 00000100:00100000:2.0:1789127320.087212:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789450496 00000100:00100000:2.0:1789127320.087245:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789127320.087252:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:10356:x1876035789450496:12345-0@lo:502: 00000100:00100000:2.0:1789127320.087340:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:10356:x1876035789450496:12345-0@lo:502: Request processed in 88us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.087347:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789127320.087620:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10356:1876035789450496:0@lo:502: 00000020:01000000:1.0:1789127320.087643:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127320.087653:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127320.087655:0:10356:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789127320.087661:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789127320.087683:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10356:1876035789450624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127320.087716:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127320.087743:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec116c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127320.087793:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789450624 00000100:00100000:2.0:1789127320.087798:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789450624 00000100:00100000:2.0:1789127320.087827:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789127320.087834:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:10356:x1876035789450624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127320.087923:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:10356:x1876035789450624:12345-0@lo:502:llog_process_th.0 Request processed in 80us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.087929:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789127320.088094:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10356:1876035789450624:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127320.088115:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127320.088120:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127320.088121:0:10356:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789127320.088124:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1789127320.088264:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789127320.088282:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789127320.088292:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.088302:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127320.088311:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789127320.088313:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9346b6688800 from 48 10000000:01000000:2.0:1789127320.088323:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789127320.088359:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.088367:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.088376:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127320.089155:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789450752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.089199:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.089385:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.089782:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789450752 00000100:00100000:1.0:1789127320.089790:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789450752 00000100:00100000:1.0:1789127320.089872:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789127320.089881:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+17:6520:x1876035789450752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127320.089893:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127320.089907:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501a800/0xd718aadfd785d597 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d590 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.089939:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501a800/0xd718aadfd785d597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d590 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.089949:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501a800/0xd718aadfd785d597 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d590 expref: 18 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.089967:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501a800, rc 0) 00000100:00100000:1.0:1789127320.090008:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789450752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.090014:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789127320.090168:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eba580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789450752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127320.090183:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d597 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.090192:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d597 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127320.090251:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789450880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.090280:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.090308:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d25240 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.090356:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789450880 00000100:00100000:1.0:1789127320.090360:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789450880 00000100:00100000:1.0:1789127320.090395:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789127320.090402:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789450880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127320.090522:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789450880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.090529:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789127320.090719:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789450880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.090748:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789451008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.090784:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.090810:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d25240 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.090970:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789451008 00000100:00100000:1.0:1789127320.090975:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789451008 00000100:00100000:1.0:1789127320.091004:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789127320.091012:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789451008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127320.091099:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789451008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.091107:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789127320.091223:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dec3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789451008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.091823:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10357:1876035789451136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.091942:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.091999:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dec900 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.092059:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789451136 00000100:00100000:1.0:1789127320.092063:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789451136 00000100:00100000:1.0:1789127320.092094:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789127320.092101:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:10357:x1876035789451136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127320.092223:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:10357:x1876035789451136:12345-0@lo:502:llog_process_th.0 Request processed in 122us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.092230:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789127320.092658:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10357:1876035789451136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.092702:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10357:1876035789451264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.092736:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.092796:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dec900 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.092834:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789451264 00000100:00100000:1.0:1789127320.092839:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789451264 00000100:00100000:1.0:1789127320.092976:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789127320.092984:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:10357:x1876035789451264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127320.093106:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:10357:x1876035789451264:12345-0@lo:502:llog_process_th.0 Request processed in 122us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.093113:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789127320.093193:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10357:1876035789451264:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789127320.093214:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789127320.093457:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789127320.093760:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127320.093771:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d597 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.093782:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d597 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127320.093840:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789127320.093844:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789127320.093847:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789127320.093953:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.093962:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.093972:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127320.093988:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789451392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.094023:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.094057:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1240 going to sleep for 11 seconds 00000100:00100000:3.0:1789127320.094109:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789451392 00000100:00100000:3.0:1789127320.094114:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789451392 00000100:00100000:3.0:1789127320.094151:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789127320.094169:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+18:6520:x1876035789451392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127320.094178:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127320.094190:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d5a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d59e expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.094211:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d5a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d59e expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.094222:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d5a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d59e expref: 19 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.094230:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a0200, rc 0) 00000100:00100000:3.0:1789127320.094269:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:6520:x1876035789451392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.094276:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789127320.094373:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789451392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127320.094397:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.094413:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d5a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127320.094474:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789451520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.094500:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.094553:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.094602:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789451520 00000100:00100000:1.0:1789127320.094607:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789451520 00000100:00100000:1.0:1789127320.094628:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789127320.094634:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:6520:x1876035789451520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127320.094735:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:6520:x1876035789451520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.094742:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789127320.094854:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789451520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.094961:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789451648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.094998:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.095019:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1240 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.095554:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789451648 00000100:00100000:1.0:1789127320.095560:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789451648 00000100:00100000:1.0:1789127320.095591:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789127320.095598:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:6520:x1876035789451648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127320.095681:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:6520:x1876035789451648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 82us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.095688:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789127320.096047:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789451648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.096429:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10358:1876035789451776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127320.096483:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.096549:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.096688:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789451776 00000100:00100000:1.0:1789127320.096693:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789451776 00000100:00100000:1.0:1789127320.096731:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1789127320.096739:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:10358:x1876035789451776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127320.096829:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:10358:x1876035789451776:12345-0@lo:502:llog_process_th.0 Request processed in 90us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.096844:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789127320.097089:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10358:1876035789451776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127320.097114:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127320.097122:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127320.097124:0:10358:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789127320.097130:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789127320.097154:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10358:1876035789451904:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127320.097190:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.097217:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.097455:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789451904 00000100:00100000:1.0:1789127320.097469:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789451904 00000100:00100000:1.0:1789127320.097571:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1789127320.097580:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:10358:x1876035789451904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127320.097658:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:10358:x1876035789451904:12345-0@lo:502:llog_process_th.0 Request processed in 79us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.097664:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789127320.097736:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10358:1876035789451904:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127320.097763:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127320.097768:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127320.097769:0:10358:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789127320.097772:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1789127320.098153:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789127320.098172:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789127320.098182:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.098191:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127320.098200:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789127320.098203:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9346b640b000 from 48 10000000:01000000:3.0:1789127320.098205:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789127320.098230:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.098237:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.098253:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127320.098268:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7deed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789452032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.098303:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.098367:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d25480 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.098419:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789452032 00000100:00100000:1.0:1789127320.098424:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789452032 00000100:00100000:1.0:1789127320.098467:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789127320.098474:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:6520:x1876035789452032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127320.098483:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127320.098495:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501be00/0xd718aadfd785d5b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d5ac expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.098743:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501be00/0xd718aadfd785d5b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d5ac expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.098754:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501be00/0xd718aadfd785d5b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d5ac expref: 20 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.098762:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501be00, rc 0) 00000100:00100000:1.0:1789127320.098791:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789452032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 318us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.098797:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1789127320.098965:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7deed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789452032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127320.098978:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.098987:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127320.099036:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7deed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789452160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.099059:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.099086:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d25480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.099134:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789452160 00000100:00100000:0.0:1789127320.099139:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789452160 00000100:00100000:0.0:1789127320.099176:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789127320.099183:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789452160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.099278:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789452160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.099284:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789127320.099367:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7deed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789452160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.099394:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7deed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789452288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.099452:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.099478:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d25480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.099656:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789452288 00000100:00100000:0.0:1789127320.099661:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789452288 00000100:00100000:0.0:1789127320.099695:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789127320.099701:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789452288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.099773:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789452288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.099779:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1789127320.099813:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7deed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789452288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.100001:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10359:1876035789452416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.100035:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.100054:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789452416 00000100:00100000:0.0:1789127320.100058:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789452416 00000100:00100000:0.0:1789127320.100076:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789127320.100081:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:10359:x1876035789452416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.100156:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:10359:x1876035789452416:12345-0@lo:502:llog_process_th.0 Request processed in 74us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.100163:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1789127320.100191:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dec600 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.100202:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10359:1876035789452416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.100237:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10359:1876035789452544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.100266:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.100285:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789452544 00000100:00100000:0.0:1789127320.100288:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789452544 00000100:00100000:0.0:1789127320.100304:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789127320.100309:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:10359:x1876035789452544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.100364:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:10359:x1876035789452544:12345-0@lo:502:llog_process_th.0 Request processed in 54us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.100387:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1789127320.100413:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.100424:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10359:1876035789452544:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789127320.100442:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789127320.100499:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789127320.100538:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789127320.100547:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.100555:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127320.100564:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789127320.100566:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1789127320.100569:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789127320.100588:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.100595:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.100603:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127320.100615:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789452672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.100638:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.100650:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.100660:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789452672 00000100:00100000:0.0:1789127320.100668:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789452672 00000100:00100000:0.0:1789127320.100684:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789127320.100689:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789452672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127320.100696:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127320.100705:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fed200/0xd718aadfd785d5c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d5ba expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.100721:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fed200/0xd718aadfd785d5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d5ba expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.100729:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fed200/0xd718aadfd785d5c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d5ba expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.100737:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fed200, rc 0) 00000100:00100000:0.0:1789127320.100762:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789452672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.100768:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789127320.100791:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789452672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127320.100801:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.100809:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127320.100844:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789452800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.100868:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.100880:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.100890:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789452800 00000100:00100000:0.0:1789127320.100898:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789452800 00000100:00100000:0.0:1789127320.100929:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789127320.100936:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789452800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.101016:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789452800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 80us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.101022:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789127320.101045:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789452800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.101066:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789452928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.101094:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.101104:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.101114:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789452928 00000100:00100000:0.0:1789127320.101117:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789452928 00000100:00100000:0.0:1789127320.101130:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789127320.101135:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789452928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.101190:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789452928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 54us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.101196:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789127320.101224:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789452928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.101404:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10360:1876035789453056:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.101433:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.101448:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789453056 00000100:00100000:0.0:1789127320.101451:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789453056 00000100:00100000:0.0:1789127320.101466:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789127320.101471:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:10360:x1876035789453056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.101555:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:10360:x1876035789453056:12345-0@lo:502:llog_process_th.0 Request processed in 83us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.101566:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1789127320.101588:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.101597:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10360:1876035789453056:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127320.101614:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127320.101620:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127320.101623:0:10360:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789127320.101627:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789127320.101642:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10360:1876035789453184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.101674:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.101692:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789453184 00000100:00100000:0.0:1789127320.101695:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789453184 00000100:00100000:0.0:1789127320.101712:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789127320.101717:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:10360:x1876035789453184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.101763:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:10360:x1876035789453184:12345-0@lo:502:llog_process_th.0 Request processed in 45us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.101769:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789127320.110585:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346828a00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.110630:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10360:1876035789453184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127320.110677:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127320.110686:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127320.110688:0:10360:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789127320.110693:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1789127320.118824:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1789127320.118895:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789127320.118906:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.118932:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127320.118944:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789127320.118946:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff934687bf9800 from 48 10000000:01000000:1.0:1789127320.118949:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789127320.118992:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.118999:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.119011:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127320.119037:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789453312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127320.119104:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127320.119262:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b726bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127320.126297:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789453312 00000100:00100000:2.0:1789127320.126313:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789453312 00000100:00100000:2.0:1789127320.126386:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789127320.126397:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789453312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127320.126412:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127320.126430:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928fea00/0xd718aadfd785d5cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d5c8 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.126470:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928fea00/0xd718aadfd785d5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d5c8 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.126483:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928fea00/0xd718aadfd785d5cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d5c8 expref: 22 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.126493:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fea00, rc 0) 00000100:00100000:2.0:1789127320.126596:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789453312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (7491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.126604:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789127320.126828:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789453312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127320.126847:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.126870:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127320.126954:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789453440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.126991:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.127029:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346828a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.127071:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789453440 00000100:00100000:1.0:1789127320.127076:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789453440 00000100:00100000:1.0:1789127320.127112:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789127320.127120:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789453440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127320.127226:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789453440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.127234:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789127320.127437:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789453440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.127476:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789453568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.127546:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.127563:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346828a00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.127671:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789453568 00000100:00100000:1.0:1789127320.127677:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789453568 00000100:00100000:1.0:1789127320.127709:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789127320.127716:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789453568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127320.127790:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789453568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.127797:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789127320.127866:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789453568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.128179:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10361:1876035789453696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.128218:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.128241:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346828a0780 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.128279:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789453696 00000100:00100000:1.0:1789127320.128285:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789453696 00000100:00100000:1.0:1789127320.128315:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789127320.128322:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:10361:x1876035789453696:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127320.128405:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:10361:x1876035789453696:12345-0@lo:502:llog_process_th.0 Request processed in 83us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.128413:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789127320.128449:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10361:1876035789453696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127320.128501:0:10361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10361:1876035789453824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127320.128559:0:10361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127320.128572:0:10361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b726b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.128758:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789453824 00000100:00100000:0.0:1789127320.128763:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789453824 00000100:00100000:0.0:1789127320.128799:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789127320.128806:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:10361:x1876035789453824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.128882:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:10361:x1876035789453824:12345-0@lo:502:llog_process_th.0 Request processed in 77us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.128890:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789127320.128971:0:10361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10361:1876035789453824:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789127320.128993:0:10361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789127320.130629:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789127320.130661:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789127320.130672:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.130695:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127320.130705:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789127320.130708:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:0.0:1789127320.130711:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789127320.130741:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.130750:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.130760:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127320.130781:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789453952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.130832:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.131050:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789127320.137696:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789453952 00000100:00100000:2.0:1789127320.137926:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789453952 00000100:00100000:3.0:1789127320.138097:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789127320.138108:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789453952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127320.138126:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127320.138144:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93469a7a0400/0xd718aadfd785d5dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d5d6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.138188:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93469a7a0400/0xd718aadfd785d5dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d5d6 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.138200:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93469a7a0400/0xd718aadfd785d5dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d5d6 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.138210:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a0400, rc 0) 00000100:00100000:2.0:1789127320.138400:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789453952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127320.138420:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127320.138528:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789453952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 400us (7673us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.138537:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00010000:00010000:2.0:1789127320.139116:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127320.139206:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789454080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.139258:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.139404:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1240 going to sleep for 11 seconds 00000100:00100000:3.0:1789127320.139540:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789454080 00000100:00100000:3.0:1789127320.139547:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789454080 00000100:00100000:3.0:1789127320.139834:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789127320.139847:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789454080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.140042:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789454080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.140050:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789127320.140123:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789454080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.140155:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789454208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.140199:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.143239:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1240 going to sleep for 11 seconds 00000100:00100000:3.0:1789127320.144114:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789454208 00000100:00100000:3.0:1789127320.144124:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789454208 00000100:00100000:3.0:1789127320.144175:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789127320.144184:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789454208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.144460:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789454208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 275us (4259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.144467:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789127320.144702:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789454208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127320.145968:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10362:1876035789454336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.146040:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.146082:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d780 going to sleep for 11 seconds 00000100:00100000:2.0:1789127320.146291:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789454336 00000100:00100000:2.0:1789127320.146297:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789454336 00000100:00100000:2.0:1789127320.146342:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789127320.146351:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:10362:x1876035789454336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127320.146465:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:10362:x1876035789454336:12345-0@lo:502:llog_process_th.0 Request processed in 115us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.146472:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789127320.146665:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10362:1876035789454336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127320.146693:0:10362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127320.146701:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127320.146704:0:10362:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789127320.146709:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789127320.146730:0:10362:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10362:1876035789454464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127320.146770:0:10362:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.146803:0:10362:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dec540 going to sleep for 11 seconds 00000100:00100000:1.0:1789127320.146840:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789454464 00000100:00100000:1.0:1789127320.146845:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789454464 00000100:00100000:1.0:1789127320.146874:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789127320.146881:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:10362:x1876035789454464:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127320.146982:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:10362:x1876035789454464:12345-0@lo:502:llog_process_th.0 Request processed in 96us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.146992:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789127320.147035:0:10362:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10362:1876035789454464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127320.147055:0:10362:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127320.147060:0:10362:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127320.147062:0:10362:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789127320.147065:0:10362:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789127320.147229:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1789127320.147255:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789127320.147264:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.147274:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127320.147284:0:6520:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789127320.147286:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9346b18f3490 from 1 10000000:01000000:1.0:1789127320.147289:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789127320.147313:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785d5e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.147320:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785d5e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127320.147329:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785d5e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127320.147343:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7389e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789454592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127320.147372:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127320.147395:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b726bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127320.148702:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789454592 00000100:00100000:0.0:1789127320.148711:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789454592 00000100:00100000:0.0:1789127320.148751:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789127320.148760:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789454592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127320.148772:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127320.148787:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fed000/0xd718aadfd785d5eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d5e4 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.148810:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fed000/0xd718aadfd785d5eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d5e4 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.148820:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fed000/0xd718aadfd785d5eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d5e4 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127320.148828:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fed000, rc 0) 00000100:00100000:0.0:1789127320.148893:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789454592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.148900:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789127320.149063:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7389e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789454592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127320.149092:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785d5e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5eb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.149100:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785d5e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d5eb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127320.149162:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dec780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789454720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127320.149194:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.149230:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d25540 going to sleep for 11 seconds 00000100:00100000:2.0:1789127320.149287:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789454720 00000100:00100000:2.0:1789127320.149291:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789454720 00000100:00100000:2.0:1789127320.149323:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1789127320.149331:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789454720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127320.149407:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789454720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (212us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127320.149422:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789127320.149502:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dec780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789454720:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789127320.149563:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789127320.149570:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785d5e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5eb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127320.149577:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785d5e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5eb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127320.254123:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127320.254228:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771569152 00000100:00100000:2.0:1789127320.254242:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771569152 00000100:00100000:2.0:1789127320.254324:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 245 00000100:00100000:2.0:1789127320.254335:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+8:6173:x1876035771569152:12345-192.168.206.48@tcp:101: 00010000:00010000:2.0:1789127320.254352:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127320.254369:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928fec00/0xd718aadfd785d5f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffaf2 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.254396:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928fec00/0xd718aadfd785d5f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaf2 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.254407:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928fec00/0xd718aadfd785d5f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaf2 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.254416:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fec00, rc 0) 00000100:00100000:2.0:1789127320.254489:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6173:x1876035771569152:12345-192.168.206.48@tcp:101: Request processed in 156us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.254497:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 245 00000100:00100000:0.0:1789127320.264850:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127320.265073:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771569280 00000100:00100000:1.0:1789127320.265087:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771569280 00000100:00100000:1.0:1789127320.265169:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 246 00000100:00100000:1.0:1789127320.265182:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6173:x1876035771569280:12345-192.168.206.48@tcp:501: 00000100:00100000:1.0:1789127320.265389:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6173:x1876035771569280:12345-192.168.206.48@tcp:501: Request processed in 209us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.265399:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 246 00000100:00100000:0.0:1789127320.270774:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127320.278729:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771569408 00000100:00100000:1.0:1789127320.278752:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771569408 00000100:00100000:1.0:1789127320.278863:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 247 00000100:00100000:1.0:1789127320.278877:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6173:x1876035771569408:12345-192.168.206.48@tcp:503: 00000100:00100000:1.0:1789127320.279122:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6173:x1876035771569408:12345-192.168.206.48@tcp:503: Request processed in 247us (8354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127320.279132:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 247 00000100:00100000:0.0:1789127320.285087:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127320.285306:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771569536 00000100:00100000:2.0:1789127320.285316:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771569536 00000100:00100000:2.0:1789127320.285385:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 248 00000100:00100000:2.0:1789127320.285396:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6656:x1876035771569536:12345-192.168.206.48@tcp:502: 00000100:00100000:2.0:1789127320.285581:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6656:x1876035771569536:12345-192.168.206.48@tcp:502: Request processed in 186us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.285591:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 248 00000100:00100000:2.0:1789127320.293624:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127320.297486:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771569664 00000100:00100000:0.0:1789127320.297500:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771569664 00000100:00100000:0.0:1789127320.297587:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 249 00000100:00100000:0.0:1789127320.297598:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6656:x1876035771569664:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127320.297752:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6656:x1876035771569664:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 155us (4136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.297768:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 249 00000100:00100000:0.0:1789127320.309485:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127320.309684:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771569792 00000100:00100000:2.0:1789127320.309694:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771569792 00000100:00100000:2.0:1789127320.309750:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 250 00000100:00100000:2.0:1789127320.309773:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6173:x1876035771569792:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127320.309789:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127320.309806:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928ffc00/0xd718aadfd785d5f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffaf9 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.309835:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928ffc00/0xd718aadfd785d5f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaf9 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.309846:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928ffc00/0xd718aadfd785d5f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaf9 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127320.309856:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ffc00, rc 0) 00000100:00100000:2.0:1789127320.309927:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6173:x1876035771569792:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 167us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.309935:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 250 00000100:00100000:3.0:1789127320.315053:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127320.316268:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771569920 00000100:00100000:1.0:1789127320.316289:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771569920 00000100:00100000:1.0:1789127320.316393:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 251 00000100:00100000:1.0:1789127320.316406:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6173:x1876035771569920:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127320.316608:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6173:x1876035771569920:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 204us (1562us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789127320.316618:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 251 00000100:00100000:2.0:1789127320.376148:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789454848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127320.376212:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789455104:0@lo:400:kworker.0 00000100:00100000:2.0:1789127320.376241:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.376409:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789454976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127320.376621:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789455360:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127320.377540:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789455232:0@lo:400:kworker.0 00000100:00100000:3.0:1789127320.378183:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.378383:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789455488:0@lo:400:kworker.0 00000100:00100000:3.0:1789127320.378429:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.378459:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789456000:0@lo:400:kworker.0 00000100:00100000:3.0:1789127320.378485:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.378593:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789454848 00000100:00100000:3.0:1789127320.378602:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789454848 00000100:00100000:3.0:1789127320.378694:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789127320.378706:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789454848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127320.378760:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789127320.378816:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789454848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (2576us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.378824:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789127320.378861:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789455104 00000100:00100000:3.0:1789127320.378866:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789455104 00000100:00100000:3.0:1789127320.378895:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789455488 00000100:00100000:3.0:1789127320.378899:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789455488 00000100:00100000:3.0:1789127320.378943:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789456000 00000100:00100000:3.0:1789127320.378946:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789456000 00000100:00100000:3.0:1789127320.379037:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789127320.379046:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7deed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789455104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127320.379170:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7deed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789455104:12345-0@lo:400:kworker.0 Request processed in 125us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.379173:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.379181:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789127320.379198:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789127320.379208:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789455488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127320.379250:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789455616:0@lo:400:kworker.0 00000100:00100000:3.0:1789127320.379382:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789455488:12345-0@lo:400:kworker.0 Request processed in 175us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.379390:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789127320.379404:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789127320.379410:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ded680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789456000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127320.379447:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ded680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789456000:12345-0@lo:400:kworker.0 Request processed in 36us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.379453:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789127320.379486:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.379557:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789455488:0@lo:400:kworker.0 00000100:00100000:2.0:1789127320.379562:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789455872:0@lo:400:kworker.0 00000100:00100000:2.0:1789127320.379599:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.379621:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789456384:0@lo:400:kworker.0 00000100:00100000:2.0:1789127320.379642:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.379690:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789456000:0@lo:400:kworker.0 00000100:00100000:3.0:1789127320.379721:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789455104:0@lo:400:kworker.0 00000100:00100000:2.0:1789127320.379722:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789454848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127320.379833:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.379861:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789456128:0@lo:400:kworker.0 00000100:00100000:0.0:1789127320.379883:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.379935:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789455872 00000100:00100000:2.0:1789127320.379943:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789455872 00000100:00100000:1.0:1789127320.379968:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127320.379993:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789456384 00000100:00100000:2.0:1789127320.380000:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789456384 00000100:00100000:1.0:1789127320.380003:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789455744:0@lo:400:kworker.0 00000100:00100000:1.0:1789127320.380169:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.382605:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789455616 00000100:00100000:0.0:1789127320.382619:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789455616 00000100:00100000:0.0:1789127320.382667:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789456128 00000100:00100000:0.0:1789127320.382671:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789456128 00000100:00100000:0.0:1789127320.382684:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789455232 00000100:00100000:0.0:1789127320.382686:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789455232 00000100:00100000:0.0:1789127320.382703:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789127320.382711:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789455616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127320.382811:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789455616:12345-0@lo:400:kworker.0 Request processed in 100us (2977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.382818:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789127320.382850:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789127320.382857:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789456128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127320.383506:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789456128:12345-0@lo:400:kworker.0 Request processed in 643us (3616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.384484:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789127320.384532:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789127320.384548:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b738b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789455232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127320.384637:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789455744 00000100:00100000:2.0:1789127320.384646:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789455744 00000100:00100000:2.0:1789127320.384696:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127320.384737:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789127320.384737:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789455872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127320.384772:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789456384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127320.384827:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b738b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789455232:12345-0@lo:400:kworker.0 Request processed in 283us (4869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.384837:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789127320.384874:0:8755:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789127320.384884:0:8755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:3.0:1789127320.384903:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789456384:12345-0@lo:400:kworker.0 Request processed in 143us (5256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.384923:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1789127320.384962:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca70c0 x1876035789455616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127320.384980:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789455616:0@lo:400:kworker.0 00010000:00080000:0.0:1789127320.384995:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca7480 x1876035789456128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127320.385004:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789456128:0@lo:400:kworker.0 00000100:00100000:3.0:1789127320.385026:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789127320.385040:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789455744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127320.385058:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789454976 00000100:00100000:0.0:1789127320.385065:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789454976 00000100:00100000:0.0:1789127320.385096:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789455360 00000100:00100000:0.0:1789127320.385100:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789455360 00000100:00100000:3.0:1789127320.385105:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73883c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789455744:12345-0@lo:400:kworker.0 Request processed in 65us (4931us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.385117:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789127320.385132:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789127320.385141:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789454976:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789127320.385163:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:0.0:1789127320.385170:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:3.0:1789127320.385174:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127320.385181:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127320.385184:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127320.385241:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789454976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (6955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.385266:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789127320.385283:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca5680 x1876035789456384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127320.385294:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789127320.385306:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789456384:0@lo:400:kworker.0 00000100:00100000:0.0:1789127320.385325:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789455360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789127320.385338:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1789127320.386281:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca5a40 x1876035789455744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127320.386297:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789455744:0@lo:400:kworker.0 00000100:00100000:1.0:1789127320.386310:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789456256:0@lo:400:kworker.0 00000100:00100000:1.0:1789127320.386368:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127320.386431:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789455232:0@lo:400:kworker.0 00000100:00100000:0.0:1789127320.386547:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789455360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1221us (7060us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.386559:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1789127320.386619:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73892c0 x1876035789454976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127320.386640:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789454976:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789127320.386677:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7dec780 x1876035789455360/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127320.386691:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789455360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127320.386814:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789456256 00000100:00100000:0.0:1789127320.386820:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789456256 00000100:00100000:0.0:1789127320.386856:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789127320.386865:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b738a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789456256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127320.386908:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b738a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789456256:12345-0@lo:400:kworker.0 Request processed in 44us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.386927:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789127320.387421:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca4f00 x1876035789456256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127320.387432:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789456256:0@lo:400:kworker.0 00000100:00100000:2.0:1789127320.389717:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eba1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789455872:12345-0@lo:400:kworker.0 Request processed in 5002us (10107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.389730:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789127320.398557:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca61c0 x1876035789455872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127320.398577:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789455872:0@lo:400:kworker.0 00010000:00010000:2.0:1789127320.503668:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127320.572117:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127320.572177:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127320.572342:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771570048 00000100:00100000:0.0:1789127320.572352:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771570048 00000100:00100000:0.0:1789127320.572446:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:0.0:1789127320.572457:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7defc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771570048:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127320.572561:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7defc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771570048:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 106us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.572569:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00080000:1.0:1789127320.572942:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127320.577794:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127320.577839:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127320.577908:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771570176 00000100:00100000:2.0:1789127320.577929:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771570176 00000100:00100000:2.0:1789127320.577994:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:2.0:1789127320.578005:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771570176:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127320.578081:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771570176:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 78us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127320.578089:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00080000:2.0:1789127320.578207:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127320.582821:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771570304 00000100:00100000:1.0:1789127320.582836:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771570304 00000100:00080000:2.0:1789127320.582925:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127320.582974:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771570432 00000100:00100000:0.0:1789127320.582979:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771570432 00000100:00100000:0.0:1789127320.583059:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:0.0:1789127320.583069:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7decf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771570304:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127320.583143:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7decf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771570304:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 76us (10978us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.583151:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:0.0:1789127320.584519:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:0.0:1789127320.584534:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771570432:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127320.587534:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dee940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771570432:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 2992us (9682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.587549:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00080000:2.0:1789127320.589548:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127320.888306:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127320.888330:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789456512:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127320.888404:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127320.888926:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789456512 00000100:00100000:3.0:1789127320.888946:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789456512 00000100:00100000:3.0:1789127320.888993:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127320.889003:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789456512:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127320.889254:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127320.889318:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789456512:12345-0@lo:13:osp-pre-0-1.0 Request processed in 317us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127320.889326:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789127320.889569:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73892c0 x1876035789456512/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127320.889603:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789456512:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127320.889879:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789456640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127320.889924:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127320.890187:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789456640 00000100:00100000:0.0:1789127320.890193:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789456640 00000100:00100000:0.0:1789127320.890276:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789127320.890285:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7def840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789456640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127320.890301:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127320.890347:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7def840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789456640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127320.890361:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789127320.890535:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca61c0 x1876035789456640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127320.890549:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789456640:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789127321.527669:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789127322.136974:0:10401:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd60998290 20000000:00000080:3.0:1789127322.136991:0:10401:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9345878e2800 uarg=0000000000000000 20000000:01000000:3.0:1789127322.137028:0:10401:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789127322.137033:0:10401:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789127322.137037:0:10401:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789127322.138163:0:10402:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789127322.138366:0:10401:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1789127322.149926:0:10401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1789127322.149963:0:10401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1789127322.149980:0:10401:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1789127322.149997:0:10401:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789127322.150017:0:10401:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.150033:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93469a7a1000/0xd718aadfd785d29c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d295 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.150041:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928fe200/0xd718aadfd785d2aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d2a3 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.150048:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346c214da00/0xd718aadfd785d2fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d2f7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.150055:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346c214d200/0xd718aadfd785d424 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d41d expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.150063:0:10401:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93468501ac00/0xd718aadfd785d53c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaba expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.150079:0:10401:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.150115:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93468501ac00/0xd718aadfd785d53c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaba expref: 9 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.150129:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93468501ac00/0xd718aadfd785d53c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaba expref: 9 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127322.150144:0:10401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1876035789456768:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127322.150286:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346c214d200/0xd718aadfd785d424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d41d expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.150295:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346c214d200/0xd718aadfd785d424 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d41d expref: 23 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127322.150309:0:10401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1876035789456896:0@lo:104: 00000100:00100000:1.0:1789127322.150348:0:10401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127322.150458:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346c214da00/0xd718aadfd785d2fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d2f7 expref: 23 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.150466:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346c214da00/0xd718aadfd785d2fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d2f7 expref: 23 pid: 6516 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127322.150475:0:10401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1876035789457024:0@lo:104: 00000100:00100000:1.0:1789127322.150501:0:10401:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127322.152206:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928fe200/0xd718aadfd785d2aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d2a3 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.152236:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928fe200/0xd718aadfd785d2aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d2a3 expref: 23 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127322.152248:0:10401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1876035789457152:0@lo:104: 00010000:00010000:1.0:1789127322.152288:0:10401:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93469a7a1000/0xd718aadfd785d29c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d295 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.152297:0:10401:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93469a7a1000/0xd718aadfd785d29c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d295 expref: 23 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127322.152305:0:10401:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1876035789457280:0@lo:104: 00000100:00100000:1.0:1789127322.152322:0:10401:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586decf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127322.154048:0:10401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738a1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1876035789456768:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127322.154251:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789456896 00000100:00100000:2.0:1789127322.154258:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789456896 00000100:00100000:2.0:1789127322.154310:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789457024 00000100:00100000:2.0:1789127322.154313:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789457024 00000100:00100000:2.0:1789127322.154328:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789127322.154337:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:10401:x1876035789456896:12345-0@lo:104: 00010000:00010000:2.0:1789127322.154352:0:9528:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d424 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127322.154436:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789127322.154445:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:10401:x1876035789457024:12345-0@lo:104: 00010000:00010000:0.0:1789127322.154454:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d2fe expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127322.154747:0:6505:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789127322.154770:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127322.154788:0:6505:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127322.154795:0:6505:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:1.0:1789127322.154801:0:6505:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00000100:00100000:1.0:1789127322.155043:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789457152 00000100:00100000:1.0:1789127322.155047:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789457152 00000100:00100000:1.0:1789127322.155070:0:6505:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:1.0:1789127322.155075:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789457280 00000100:00100000:1.0:1789127322.155078:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789457280 00000100:00100000:3.0:1789127322.155182:0:10403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789127322.155190:0:10403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:10401:x1876035789457152:12345-0@lo:104: 00010000:00010000:3.0:1789127322.155200:0:10403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d2aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127322.155360:0:9528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789127322.155368:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73892c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:10401:x1876035789456896:12345-0@lo:104: Request processed in 1031us (5019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127322.155376:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789127322.155392:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789127322.155398:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:10401:x1876035789457280:12345-0@lo:104: 00010000:00010000:2.0:1789127322.155406:0:9528:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346928fe600/0xd718aadfd785d295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d29c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127322.155813:0:10403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789127322.155820:0:10403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:10401:x1876035789457152:12345-0@lo:104: Request processed in 631us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127322.155827:0:10403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1789127322.155883:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127322.155890:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d424 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127322.155911:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1800 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127322.155916:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d424 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127322.155926:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d424 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127322.155933:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d424 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127322.155939:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127322.155978:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d424 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127322.155985:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127322.156004:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d424 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127322.156028:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d41d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d424 expref: -99 pid: 9517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127322.156040:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127322.156043:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d2aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127322.156048:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ffa00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127322.156051:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d2aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127322.156057:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d2aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127322.156063:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d2aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127322.156067:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127322.156082:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d2aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127322.156087:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127322.156101:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d2aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127322.156108:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928ffa00/0xd718aadfd785d2a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d2aa expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127322.156117:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127322.156124:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127322.156127:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127322.156448:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127322.156463:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789457536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127322.156550:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127322.156611:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789457536 00000100:00100000:3.0:1789127322.156617:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789457536 00010000:00010000:3.0:1789127322.156643:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928fe200/0xd718aadfd785d2aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d2a3 expref: 24 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127322.156669:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789127322.156679:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789457536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127322.156690:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127322.156694:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928fe200/0xd718aadfd785d2aa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d2a3 expref: 24 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127322.156715:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928fe200/0xd718aadfd785d2aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d2a3 expref: 24 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127322.156733:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127322.156766:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789457536:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127322.156772:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789127322.156804:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789457536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127322.157119:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127322.157501:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771570560 00000100:00100000:3.0:1789127322.157530:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771570560 00010000:00010000:3.0:1789127322.157550:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93468501ac00/0xd718aadfd785d53c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaba expref: 10 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127322.157584:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:3.0:1789127322.157592:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2402:x1876035771570560:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127322.157601:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127322.157606:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93468501ac00/0xd718aadfd785d53c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaba expref: 10 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127322.157627:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93468501ac00/0xd718aadfd785d53c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaba expref: 10 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127322.157639:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501ac00/0xd718aadfd785d53c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaba expref: 10 pid: 6514 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127322.157650:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127322.157683:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:2402:x1876035771570560:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 92us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127322.157690:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00010000:00010000:3.0:1789127322.160030:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127322.160830:0:9528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789127322.160842:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:10401:x1876035789457280:12345-0@lo:104: Request processed in 5441us (6049us total) trans 0 rc 0/0 00010000:00010000:3.0:1789127322.160853:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1789127322.160854:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:3.0:1789127322.160861:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928fe600/0xd718aadfd785d295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d29c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127322.160869:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe600 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:3.0:1789127322.160873:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928fe600/0xd718aadfd785d295 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d29c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127322.160882:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928fe600/0xd718aadfd785d295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d29c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789127322.160889:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928fe600/0xd718aadfd785d295 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d29c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127322.160894:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789127322.161245:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789127322.161253:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed2d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:10401:x1876035789457024:12345-0@lo:104: Request processed in 6809us (10750us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127322.161275:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1789127322.161314:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127322.161319:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d2fe expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127322.161326:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1200 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127322.161328:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d2fe expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127322.161334:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d2fe expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127322.161340:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d2fe expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127322.161344:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789127322.161380:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d2fe expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127322.161386:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127322.161404:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d2fe expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127322.161411:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a1200/0xd718aadfd785d2f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d2fe expref: -99 pid: 8431 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127322.161426:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127322.161427:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127322.161429:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127322.161435:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127322.161456:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789457664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127322.163303:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127322.163364:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789457664 00000100:00100000:3.0:1789127322.163373:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789457664 00010000:00010000:2.0:1789127322.163401:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346928fe600/0xd718aadfd785d295 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d29c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127322.163404:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346c214da00/0xd718aadfd785d2fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d2f7 expref: 24 pid: 6516 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127322.163410:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127322.163421:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928fe600/0xd718aadfd785d295 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d29c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127322.163426:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928fe600/0xd718aadfd785d295 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d29c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127322.163442:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127322.163443:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00010000:00010000:2.0:1789127322.163444:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127322.163446:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127322.163450:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789457664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127322.163463:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127322.163469:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346c214da00/0xd718aadfd785d2fe lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d2f7 expref: 24 pid: 6516 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127322.163478:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346c214da00/0xd718aadfd785d2fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d2f7 expref: 24 pid: 6516 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127322.163493:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127322.163567:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789457664:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127322.163641:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789127322.163800:0:10401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1876035789456896:0@lo:104: 00000100:00100000:1.0:1789127322.163820:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789457408:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127322.163837:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789457664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127322.163984:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127322.164055:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127322.164062:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458783ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789457792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127322.164094:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127322.164189:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346c214da00/0xd718aadfd785d2fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d2f7 expref: 23 pid: 6516 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127322.164201:0:10401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a1e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1876035789457024:0@lo:104: 00010000:00010000:1.0:1789127322.164211:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928fe200/0xd718aadfd785d2aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d2a3 expref: 22 pid: 6514 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127322.164219:0:10401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1876035789457152:0@lo:104: 00000100:00100000:1.0:1789127322.164228:0:10401:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a1680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10401:1876035789457280:0@lo:104: 00010000:00010000:1.0:1789127322.164257:0:10401:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127322.164302:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789457408 00000100:00100000:0.0:1789127322.164307:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789457408 00000100:00100000:2.0:1789127322.164365:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789457792 00000100:00100000:2.0:1789127322.164370:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789457792 00010000:00010000:2.0:1789127322.164383:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93469a7a1000/0xd718aadfd785d29c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d295 expref: 23 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.164383:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346c214d200/0xd718aadfd785d424 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d41d expref: 23 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127322.164414:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789127322.164421:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:3653:x1876035789457792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127322.164429:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127322.164433:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93469a7a1000/0xd718aadfd785d29c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d295 expref: 23 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127322.164442:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93469a7a1000/0xd718aadfd785d29c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d295 expref: 23 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127322.164449:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789127322.164455:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9de9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:3653:x1876035789457408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127322.164462:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127322.164466:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93469a7a1000/0xd718aadfd785d29c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d295 expref: 23 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.164466:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346c214d200/0xd718aadfd785d424 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d41d expref: 23 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.164476:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346c214d200/0xd718aadfd785d424 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d41d expref: 22 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127322.164488:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127322.164542:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:3653:x1876035789457792:12345-0@lo:103:ldlm_bl.0 Request processed in 121us (447us total) trans 0 rc 0/0 00010000:00010000:1.0:1789127322.164544:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346c214d200/0xd718aadfd785d424 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d41d expref: 22 pid: 6517 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127322.164549:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:1.0:1789127322.164555:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.164580:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.164595:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.164602:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.164609:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.164615:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.164621:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501ba00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127322.164624:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.164631:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.164645:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.164652:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127322.164677:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9de9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:3653:x1876035789457408:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127322.164683:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789127322.165037:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458783ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789457792:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127322.165045:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789457408:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127322.165088:0:10401:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.165103:0:10401:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127322.165109:0:10401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501ba00/0xd718aadfd785d600 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127322.552990:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127323.575972:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127323.644799:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127323.644959:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771570688 00000100:00100000:1.0:1789127323.644968:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771570688 00000100:00100000:1.0:1789127323.645055:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 252 00000100:00100000:1.0:1789127323.645065:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:6173:x1876035771570688:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127323.645080:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127323.645098:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501ae00/0xd718aadfd785d607 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffb00 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.645126:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501ae00/0xd718aadfd785d607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb00 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.645159:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501ae00/0xd718aadfd785d607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb00 expref: 10 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.645168:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501ae00, rc 0) 00000100:00100000:1.0:1789127323.645229:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6173:x1876035771570688:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 165us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127323.645236:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 252 00000100:00100000:0.0:1789127323.648922:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127323.649049:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771570816 00000100:00100000:3.0:1789127323.649059:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771570816 00000100:00100000:3.0:1789127323.649264:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 253 00000100:00100000:3.0:1789127323.649276:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6173:x1876035771570816:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127323.649423:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6173:x1876035771570816:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 149us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127323.649431:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 253 00000100:00100000:3.0:1789127323.657016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127323.657050:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771570944 00000100:00100000:3.0:1789127323.657060:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771570944 00000100:00100000:3.0:1789127323.657104:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 254 00000100:00100000:3.0:1789127323.657114:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934688ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6173:x1876035771570944:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127323.657270:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934688ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6173:x1876035771570944:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 157us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127323.657278:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 254 00000100:00100000:3.0:1789127323.665459:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127323.665496:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771571072 00000100:00100000:3.0:1789127323.665505:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771571072 00000100:00100000:3.0:1789127323.665565:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 255 00000100:00100000:3.0:1789127323.665574:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934688ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6719:x1876035771571072:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789127323.665703:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934688ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6719:x1876035771571072:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 128us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127323.665711:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 255 00000100:00100000:1.0:1789127323.671425:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127323.671470:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771571200 00000100:00100000:3.0:1789127323.671481:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771571200 00000100:00100000:3.0:1789127323.671550:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 256 00000100:00100000:3.0:1789127323.671560:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6719:x1876035771571200:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789127323.672633:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:6719:x1876035771571200:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 1069us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127323.672648:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 256 10000000:01000000:2.0:1789127323.831719:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127323.831726:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934586ebc000 from 4 10000000:01000000:2.0:1789127323.831731:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127323.831780:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127323.831792:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127323.831804:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127323.831831:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789457920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127323.831927:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127323.832028:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789127323.835726:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789457920 00000100:00100000:1.0:1789127323.835740:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789457920 00000100:00100000:1.0:1789127323.835808:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789127323.835820:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789457920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127323.836165:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127323.836185:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501b000/0xd718aadfd785d615 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d60e expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.836214:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501b000/0xd718aadfd785d615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d60e expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.836224:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501b000/0xd718aadfd785d615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d60e expref: 21 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.836233:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b000, rc 0) 00000100:00100000:1.0:1789127323.836364:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789457920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 533us (4422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127323.836372:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1789127323.836668:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789457920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127323.836689:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d615 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127323.836706:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d615 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127323.836789:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789458048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127323.836825:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127323.837040:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789127323.838033:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789458048 00000100:00100000:3.0:1789127323.838045:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789458048 00000100:00100000:3.0:1789127323.838093:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789127323.838102:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789458048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127323.838248:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789458048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127323.838255:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789127323.838452:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789458048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127323.838501:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789458176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127323.838589:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127323.838610:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789127323.838718:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789458176 00000100:00100000:1.0:1789127323.838724:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789458176 00000100:00100000:1.0:1789127323.838752:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789127323.838760:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789458176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.838855:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789458176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127323.838868:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789127323.839060:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789458176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127323.839391:0:10483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10483:1876035789458304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127323.839430:0:10483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127323.839453:0:10483:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586e2e300 going to sleep for 11 seconds 00000100:00100000:1.0:1789127323.839662:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789458304 00000100:00100000:1.0:1789127323.839667:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789458304 00000100:00100000:1.0:1789127323.839698:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789127323.839705:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:10483:x1876035789458304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127323.839787:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:10483:x1876035789458304:12345-0@lo:502:llog_process_th.0 Request processed in 82us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127323.839801:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1789127323.840016:0:10483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10483:1876035789458304:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127323.840041:0:10483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127323.840052:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127323.840054:0:10483:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789127323.840061:0:10483:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff934586ebc000 00000020:00000080:2.0:1789127323.840064:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789127323.840145:0:10483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10483:1876035789458432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127323.840181:0:10483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127323.840202:0:10483:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346867f5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127323.841018:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789458432 00000100:00100000:1.0:1789127323.841026:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789458432 00000100:00100000:1.0:1789127323.841066:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789127323.841075:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:10483:x1876035789458432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127323.841184:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:10483:x1876035789458432:12345-0@lo:502:llog_process_th.0 Request processed in 109us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127323.841191:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789127323.842995:0:10483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10483:1876035789458432:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127323.843042:0:10483:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127323.843050:0:10483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127323.843052:0:10483:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789127323.843057:0:10483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789127323.843373:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789127323.843393:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127323.843404:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d615 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.843415:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d615 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127323.843425:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789127323.843427:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b6688800 from 4 10000000:01000000:1.0:1789127323.843430:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789127323.843463:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.843470:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.843479:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127323.843501:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789458560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.843964:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127323.844004:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127323.844339:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789458560 00000100:00100000:2.0:1789127323.844347:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789458560 00000100:00100000:2.0:1789127323.844536:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789127323.844548:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789458560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127323.844562:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127323.844591:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928ff000/0xd718aadfd785d623 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d61c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127323.844615:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928ff000/0xd718aadfd785d623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d61c expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127323.844625:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928ff000/0xd718aadfd785d623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d61c expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127323.844634:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff000, rc 0) 00000100:00100000:2.0:1789127323.844680:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789458560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127323.844687:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789127323.844847:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789458560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127323.844871:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d623 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.844880:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d623 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127323.844951:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789458688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.844983:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127323.845006:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127323.845020:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789458688 00000100:00100000:1.0:1789127323.845023:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789458688 00000100:00100000:1.0:1789127323.845053:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789127323.845061:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789458688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.845168:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789458688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127323.845176:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789127323.845209:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789458688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.845242:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789458816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.845286:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127323.845302:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127323.845313:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789458816 00000100:00100000:1.0:1789127323.845317:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789458816 00000100:00100000:1.0:1789127323.845342:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789127323.845372:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789458816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.845450:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789458816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127323.845457:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789127323.845499:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789458816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.845708:0:10485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10485:1876035789458944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127323.845746:0:10485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127323.845767:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789458944 00000100:00100000:1.0:1789127323.845771:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789458944 00000100:00100000:1.0:1789127323.845793:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789127323.845800:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:10485:x1876035789458944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127323.845867:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:10485:x1876035789458944:12345-0@lo:502:llog_process_th.0 Request processed in 67us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127323.845874:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789127323.845913:0:10485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789127323.845925:0:10485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10485:1876035789458944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127323.845944:0:10485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127323.845952:0:10485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127323.845954:0:10485:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789127323.845963:0:10485:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9346b6688800 00000020:00000080:1.0:1789127323.845965:0:10485:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789127323.846500:0:10485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10485:1876035789459072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127323.846564:0:10485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127323.846589:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789459072 00000100:00100000:1.0:1789127323.846594:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789459072 00000100:00100000:1.0:1789127323.846629:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789127323.846636:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:10485:x1876035789459072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127323.846707:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:10485:x1876035789459072:12345-0@lo:502:llog_process_th.0 Request processed in 71us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127323.846714:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789127323.846744:0:10485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789127323.846758:0:10485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10485:1876035789459072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127323.846778:0:10485:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127323.846783:0:10485:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127323.846785:0:10485:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789127323.846791:0:10485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789127323.846845:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789127323.846864:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127323.846873:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d623 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.846884:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d623 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127323.846906:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789127323.846908:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b640b000 from 4 10000000:01000000:1.0:1789127323.846911:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789127323.846936:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.846943:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.846951:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127323.846971:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789459200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.846997:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127323.847009:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789127323.847021:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789459200 00000100:00100000:1.0:1789127323.847024:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789459200 00000100:00100000:1.0:1789127323.847044:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789127323.847050:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789459200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127323.847057:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127323.847067:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501b600/0xd718aadfd785d631 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d62a expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.847084:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501b600/0xd718aadfd785d631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d62a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.847092:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501b600/0xd718aadfd785d631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d62a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.847099:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b600, rc 0) 00000100:00100000:1.0:1789127323.847125:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789459200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127323.847130:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789127323.847158:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789459200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127323.847170:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d631 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.847177:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d631 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127323.847222:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789459328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.847246:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127323.847259:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789127323.847270:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789459328 00000100:00100000:1.0:1789127323.847273:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789459328 00000100:00100000:1.0:1789127323.847294:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789127323.847300:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789459328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.847381:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789459328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127323.847387:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789127323.847415:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789459328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.847441:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789459456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.847478:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127323.847490:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789127323.847500:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789459456 00000100:00100000:1.0:1789127323.847503:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789459456 00000100:00100000:1.0:1789127323.847550:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789127323.847558:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789459456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.847631:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789459456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127323.847639:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789127323.848501:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789459456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127323.849093:0:10486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10486:1876035789459584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127323.849145:0:10486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127323.849170:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789459584 00000100:00100000:2.0:1789127323.849174:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789459584 00000100:00100000:2.0:1789127323.849247:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789127323.849256:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:10486:x1876035789459584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127323.849432:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:10486:x1876035789459584:12345-0@lo:502:llog_process_th.0 Request processed in 176us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127323.849439:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789127323.849484:0:10486:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346867f5600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127323.849501:0:10486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10486:1876035789459584:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127323.849667:0:10486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127323.849676:0:10486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127323.849679:0:10486:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789127323.849684:0:10486:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9346b640b000 00000020:00000080:2.0:1789127323.849686:0:10486:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789127323.849793:0:10486:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10486:1876035789459712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127323.849827:0:10486:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127323.849858:0:10486:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346867f5600 going to sleep for 11 seconds 00000100:00100000:1.0:1789127323.850219:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789459712 00000100:00100000:1.0:1789127323.850229:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789459712 00000100:00100000:1.0:1789127323.850306:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789127323.850314:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:10486:x1876035789459712:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127323.850409:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:10486:x1876035789459712:12345-0@lo:502:llog_process_th.0 Request processed in 96us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127323.850417:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789127323.850532:0:10486:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587839e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10486:1876035789459712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127323.850555:0:10486:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127323.850561:0:10486:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127323.850633:0:10486:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789127323.850638:0:10486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789127323.850788:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789127323.850806:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127323.850815:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d631 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.850826:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d631 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127323.850977:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789127323.850981:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934687bf9800 from 4 10000000:01000000:1.0:1789127323.850984:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789127323.851009:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.851018:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127323.851026:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127323.851041:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789459840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127323.851073:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127323.851213:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127323.851249:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789459840 00000100:00100000:2.0:1789127323.851254:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789459840 00000100:00100000:2.0:1789127323.851322:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1789127323.851331:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789459840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127323.851341:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127323.851540:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d63f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d638 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127323.851562:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d638 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127323.851651:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d638 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127323.851659:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ffa00, rc 0) 00000100:00100000:2.0:1789127323.851694:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789459840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 366us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127323.851700:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789127323.852391:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a03c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789459840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127323.852411:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d63f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127323.852421:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d63f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127323.852487:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789459968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127323.852540:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127323.852568:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec7d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127323.852583:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789459968 00000100:00100000:0.0:1789127323.852588:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789459968 00000100:00100000:0.0:1789127323.852621:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789127323.852629:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789459968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127323.852758:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789459968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127323.852765:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789127323.852800:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789459968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127323.852827:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789460096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127323.852868:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127323.852916:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec7d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127323.856036:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789460096 00000100:00100000:2.0:1789127323.856053:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789460096 00000100:00100000:2.0:1789127323.856113:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789127323.856124:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789460096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127323.856293:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789460096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (3423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127323.856302:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789127323.857923:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789460096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127323.860270:0:10488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10488:1876035789460224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127323.860367:0:10488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127323.860459:0:10488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec7d300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127323.867554:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789460224 00000100:00100000:2.0:1789127323.867802:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789460224 00000100:00100000:2.0:1789127323.867885:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789127323.867998:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:10488:x1876035789460224:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127323.868152:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:10488:x1876035789460224:12345-0@lo:502:llog_process_th.0 Request processed in 158us (7798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127323.868159:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789127323.868277:0:10488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10488:1876035789460224:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127323.868457:0:10488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127323.868467:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127323.868469:0:10488:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789127323.868478:0:10488:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff934687bf9800 00000020:00000080:1.0:1789127323.868481:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789127323.869023:0:10488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a1e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10488:1876035789460352:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127323.869083:0:10488:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127323.869122:0:10488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a13c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127323.869404:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789460352 00000100:00100000:0.0:1789127323.869410:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789460352 00000100:00100000:0.0:1789127323.869484:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789127323.869493:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:10488:x1876035789460352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127323.869632:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:10488:x1876035789460352:12345-0@lo:502:llog_process_th.0 Request processed in 140us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127323.869640:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789127323.869721:0:10488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a1e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:10488:1876035789460352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127323.869745:0:10488:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127323.869751:0:10488:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127323.869753:0:10488:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789127323.869759:0:10488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789127323.870212:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789127323.870235:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127323.870247:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d63f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127323.870271:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d63f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127324.599739:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127324.983776:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127324.983802:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789460480:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127324.983893:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127324.983966:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789460480 00000100:00100000:1.0:1789127324.983974:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789460480 00000100:00100000:1.0:1789127324.984020:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789127324.984029:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789460480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127324.984063:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789127324.984108:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789460480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127324.984114:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789127324.984158:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789460480:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127325.495828:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789460608:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127325.495912:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127325.496076:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789460608 00000100:00100000:0.0:1789127325.496083:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789460608 00000100:00100000:0.0:1789127325.496137:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789127325.496147:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789460608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789127325.496179:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127325.496224:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789460608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127325.496231:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789127325.496353:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789460608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127325.496603:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789460736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127325.496632:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127325.496662:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789460736 00000100:00100000:0.0:1789127325.496666:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789460736 00000100:00100000:0.0:1789127325.496698:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127325.496705:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789460736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789127325.496734:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127325.496764:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789460736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127325.496770:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789127325.496795:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca70c0 x1876035789460736/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127325.496806:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789460736:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127325.496995:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127325.497004:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789460864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127325.497035:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127325.497055:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789460864 00000100:00100000:1.0:1789127325.497059:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789460864 00000100:00100000:1.0:1789127325.497079:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789127325.497084:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789460864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789127325.497093:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127325.497117:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789460864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 33us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127325.497122:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789127325.497143:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345884a1e00 x1876035789460864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127325.497154:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789460864:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789127325.497289:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127325.497299:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789461248:0@lo:400:kworker.0 00000100:00100000:2.0:1789127325.497338:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127325.497357:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789461760:0@lo:400:kworker.0 00000100:00100000:2.0:1789127325.497380:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127325.497398:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789127325.497404:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789461120:0@lo:400:kworker.0 00000100:00100000:2.0:1789127325.497426:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127325.497442:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7389680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789461632:0@lo:400:kworker.0 00000100:00100000:2.0:1789127325.497462:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127325.497485:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789461248 00000100:00100000:2.0:1789127325.497488:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789461248 00000100:00100000:2.0:1789127325.497541:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789461120 00000100:00100000:2.0:1789127325.497545:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789461120 00000100:00100000:2.0:1789127325.497681:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789127325.497689:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789461248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127325.497725:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789461248:12345-0@lo:400:kworker.0 Request processed in 37us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127325.497742:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789127325.497759:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789127325.497765:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789461120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127325.497794:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789461120:12345-0@lo:400:kworker.0 Request processed in 30us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127325.497800:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789127325.497817:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789461760 00000100:00100000:2.0:1789127325.497820:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789461760 00000100:00100000:2.0:1789127325.497848:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789461632 00000100:00100000:2.0:1789127325.497851:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789461632 00000100:00100000:2.0:1789127325.497871:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789127325.497877:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789461760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127325.497982:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458783b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789460992:0@lo:400:kworker.0 00000100:00100000:1.0:1789127325.498014:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127325.498040:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789461504:0@lo:400:kworker.0 00000100:00100000:1.0:1789127325.498061:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127325.498077:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789462016:0@lo:400:kworker.0 00000100:00100000:1.0:1789127325.498097:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127325.498109:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789127325.498114:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789461376:0@lo:400:kworker.0 00000100:00100000:1.0:1789127325.498135:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127325.498146:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789461888:0@lo:400:kworker.0 00000100:00100000:1.0:1789127325.498166:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127325.502366:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789461504 00000100:00100000:2.0:1789127325.502374:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789461504 00000100:00100000:2.0:1789127325.502419:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789462016 00000100:00100000:2.0:1789127325.502422:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789462016 00000100:00100000:2.0:1789127325.502438:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789461376 00000100:00100000:2.0:1789127325.502440:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789461376 00000100:00100000:2.0:1789127325.502452:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789461888 00000100:00100000:2.0:1789127325.502455:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789461888 00000100:00100000:2.0:1789127325.502472:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789127325.502481:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789461504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127325.502862:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789461504:12345-0@lo:400:kworker.0 Request processed in 379us (4797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127325.502871:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789127325.502908:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789127325.502916:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789462016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127325.502964:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789462016:12345-0@lo:400:kworker.0 Request processed in 50us (4866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127325.502971:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789127325.502989:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789127325.502995:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789461376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127325.503023:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789461376:12345-0@lo:400:kworker.0 Request processed in 28us (4887us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127325.503029:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789127325.503039:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789127325.503044:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789461888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127325.503069:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789461888:12345-0@lo:400:kworker.0 Request processed in 25us (4903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127325.503074:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789127325.503094:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789127325.503101:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789461632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127325.503131:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789461632:12345-0@lo:400:kworker.0 Request processed in 32us (5669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127325.503136:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789127325.503170:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789460992 00000100:00100000:2.0:1789127325.503175:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789460992 00000100:00100000:2.0:1789127325.503207:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789127325.503214:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789460992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127325.503243:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789460992:12345-0@lo:400:kworker.0 Request processed in 30us (5228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127325.503249:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:2.0:1789127325.503285:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127325.503290:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127325.503293:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127325.503346:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7389e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789461120:0@lo:400:kworker.0 00010000:00080000:2.0:1789127325.503360:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7389680 x1876035789461632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127325.503371:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7389680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789461632:0@lo:400:kworker.0 00000100:00100000:2.0:1789127325.503382:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789461248:0@lo:400:kworker.0 00000100:00100000:2.0:1789127325.503446:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789461760:12345-0@lo:400:kworker.0 Request processed in 5569us (6064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127325.503453:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1789127325.504840:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7389a40 x1876035789461760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127325.504857:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789461760:0@lo:400:kworker.0 00010000:00080000:1.0:1789127325.505639:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b738b840 x1876035789461504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127325.505664:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789461504:0@lo:400:kworker.0 00010000:00080000:1.0:1789127325.505679:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7390780 x1876035789462016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127325.505687:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789462016:0@lo:400:kworker.0 00000100:00100000:1.0:1789127325.505708:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789461376:0@lo:400:kworker.0 00000100:00100000:1.0:1789127325.505720:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789461888:0@lo:400:kworker.0 00000100:00100000:1.0:1789127325.505730:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458783b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789460992:0@lo:400:kworker.0 00010000:00010000:0.0:1789127325.624702:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127325.695129:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127325.695292:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127325.695319:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127325.695337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127325.695369:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127325.695468:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771571584 00000100:00100000:3.0:1789127325.695489:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771571584 00000100:00100000:3.0:1789127325.695591:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771571456 00000100:00100000:3.0:1789127325.695594:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771571456 00000100:00100000:3.0:1789127325.695619:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:3.0:1789127325.695628:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771571584:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127325.695698:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771571584:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 72us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127325.695706:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:3.0:1789127325.695724:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:3.0:1789127325.695731:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771571456:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127325.695755:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771571456:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127325.695761:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:3.0:1789127325.695779:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771571840 00000100:00100000:3.0:1789127325.695783:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771571840 00000100:00100000:3.0:1789127325.695808:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771571712 00000100:00100000:3.0:1789127325.695811:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771571712 00000100:00100000:3.0:1789127325.695832:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:3.0:1789127325.695839:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771571840:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127325.695860:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771571840:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 23us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127325.695866:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:3.0:1789127325.695875:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:3.0:1789127325.695880:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771571712:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127325.695912:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771571712:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 32us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127325.695929:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00080000:1.0:1789127325.698088:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789127325.698096:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127325.698099:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127325.698102:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127325.701987:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771571328 00000100:00100000:2.0:1789127325.702001:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771571328 00000100:00100000:2.0:1789127325.702067:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 278 00000100:00100000:2.0:1789127325.702079:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2402:x1876035771571328:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127325.702202:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2402:x1876035771571328:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 125us (7083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127325.702210:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 278 00000100:00100000:3.0:1789127326.010915:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127326.010939:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ded2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789462144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127326.011001:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127326.011064:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789462144 00000100:00100000:3.0:1789127326.011071:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789462144 00000100:00100000:3.0:1789127326.011116:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127326.011125:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789462144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127326.011156:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127326.011196:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789462144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127326.011204:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789127326.011243:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7ded2c0 x1876035789462144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127326.011261:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ded2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789462144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127326.018639:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789462272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127326.018722:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127326.021791:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789462272 00000100:00100000:1.0:1789127326.021805:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789462272 00000100:00100000:1.0:1789127326.021910:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789127326.021920:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789462272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127326.021946:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127326.022026:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789462272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (3316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127326.022033:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1789127326.025788:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345884a3c00 x1876035789462272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127326.025818:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789462272:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789127326.651659:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127327.671732:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127328.700609:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789127328.815829:0:10701:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1789127329.720341:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127330.106991:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789462400:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127330.107061:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127330.107146:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789462400 00000100:00100000:1.0:1789127330.107152:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789462400 00000100:00100000:1.0:1789127330.107194:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789127330.107202:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789462400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127330.107236:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789127330.107276:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789462400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127330.107284:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789127330.107329:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789462400:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127330.616016:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789462784:0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.616091:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127330.616154:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7395680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789463296:0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.616180:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127330.616196:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789463808:0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.616229:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127330.616262:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789127330.616268:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789462656:0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.616291:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127330.616309:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789463168:0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.616329:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127330.616345:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789463680:0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.616367:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127330.616393:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789462784 00000100:00100000:3.0:1789127330.616399:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789462784 00000100:00100000:3.0:1789127330.616433:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789462656 00000100:00100000:3.0:1789127330.616435:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789462656 00000100:00100000:3.0:1789127330.616447:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789463168 00000100:00100000:3.0:1789127330.616449:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789463168 00000100:00100000:3.0:1789127330.616466:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789463680 00000100:00100000:3.0:1789127330.616469:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789463680 00000100:00100000:3.0:1789127330.616483:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789127330.616491:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789462784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.616570:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789462784:12345-0@lo:400:kworker.0 Request processed in 79us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127330.616577:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789127330.616593:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789127330.616598:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789462656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.616619:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789462656:12345-0@lo:400:kworker.0 Request processed in 22us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127330.616625:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789127330.616633:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789127330.616644:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789463168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.616666:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789463168:12345-0@lo:400:kworker.0 Request processed in 23us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127330.616671:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789127330.616680:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789127330.616685:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789463680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.616703:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789463680:12345-0@lo:400:kworker.0 Request processed in 19us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127330.616709:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789127330.616722:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789463296 00000100:00100000:3.0:1789127330.616725:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789463296 00000100:00100000:3.0:1789127330.616743:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789463808 00000100:00100000:3.0:1789127330.616745:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789463808 00000100:00100000:3.0:1789127330.616759:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789127330.616764:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789463296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.616798:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789463296:12345-0@lo:400:kworker.0 Request processed in 34us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127330.616804:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789127330.616813:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127330.616818:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789463808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.616837:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789463808:12345-0@lo:400:kworker.0 Request processed in 19us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127330.616842:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127330.616897:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789462656:0@lo:400:kworker.0 00010000:00080000:3.0:1789127330.616908:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7394f00 x1876035789463168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127330.616930:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789463168:0@lo:400:kworker.0 00010000:00080000:3.0:1789127330.616940:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7ebf0c0 x1876035789463680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127330.616949:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789463680:0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.616956:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789462784:0@lo:400:kworker.0 00010000:00080000:3.0:1789127330.616964:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7395680 x1876035789463296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127330.616972:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7395680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789463296:0@lo:400:kworker.0 00010000:00080000:3.0:1789127330.616979:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7ebda40 x1876035789463808/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127330.616986:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789463808:0@lo:400:kworker.0 00000100:00100000:2.0:1789127330.617156:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345860461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789462912:0@lo:400:kworker.0 00000100:00100000:2.0:1789127330.617187:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127330.617211:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789463424:0@lo:400:kworker.0 00000100:00100000:2.0:1789127330.617229:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127330.617242:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789463936:0@lo:400:kworker.0 00000100:00100000:2.0:1789127330.617266:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127330.617283:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789127330.617288:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789462528:0@lo:400:kworker.0 00000100:00100000:2.0:1789127330.617309:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127330.617326:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586044780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789463040:0@lo:400:kworker.0 00000100:00100000:2.0:1789127330.617342:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127330.617354:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789463552:0@lo:400:kworker.0 00000100:00100000:2.0:1789127330.617369:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127330.617389:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789463424 00000100:00100000:2.0:1789127330.617392:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789463424 00000100:00100000:2.0:1789127330.617414:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789463936 00000100:00100000:2.0:1789127330.617416:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789463936 00000100:00100000:2.0:1789127330.617430:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127330.617435:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789463424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127330.617463:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789463424:12345-0@lo:400:kworker.0 Request processed in 28us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127330.617469:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127330.617479:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127330.617484:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789463936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127330.617503:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789463936:12345-0@lo:400:kworker.0 Request processed in 19us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127330.617527:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127330.617541:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789463040 00000100:00100000:2.0:1789127330.617544:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789463040 00000100:00100000:2.0:1789127330.617562:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789463552 00000100:00100000:2.0:1789127330.617564:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789463552 00000100:00100000:2.0:1789127330.617574:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789127330.617584:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789463040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127330.617609:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789463040:12345-0@lo:400:kworker.0 Request processed in 26us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127330.617615:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789127330.617624:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789127330.617629:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789463552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127330.617647:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789463552:12345-0@lo:400:kworker.0 Request processed in 19us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127330.617653:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789127330.617680:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586044780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789463040:0@lo:400:kworker.0 00000100:00100000:2.0:1789127330.617688:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789463552:0@lo:400:kworker.0 00010000:00080000:2.0:1789127330.617697:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73961c0 x1876035789463424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127330.617705:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789463424:0@lo:400:kworker.0 00010000:00080000:2.0:1789127330.617712:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7ebe1c0 x1876035789463936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127330.617720:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789463936:0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.621154:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789462912 00000100:00100000:3.0:1789127330.621169:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789462912 00000100:00100000:3.0:1789127330.621255:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789127330.621267:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789462912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.621363:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789462912:12345-0@lo:400:kworker.0 Request processed in 99us (4174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127330.621371:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789127330.621395:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789462528 00000100:00100000:3.0:1789127330.621399:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789462528 00000100:00100000:3.0:1789127330.621422:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789127330.621428:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789462528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.621473:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789462528:12345-0@lo:400:kworker.0 Request processed in 45us (4162us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127330.621479:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789127330.621560:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789462528:0@lo:400:kworker.0 00000100:00100000:3.0:1789127330.621575:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345860461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789462912:0@lo:400:kworker.0 00000100:00100000:0.0:1789127330.621872:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789464192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127330.621910:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127330.621964:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127330.621970:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789464064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127330.621998:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789127330.622834:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127330.622842:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127330.622845:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789127330.622847:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127330.622877:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789464192 00000100:00100000:1.0:1789127330.622884:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789464192 00000100:00100000:1.0:1789127330.622926:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789127330.622934:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789464192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789127330.622957:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127330.623006:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca4b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789464192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127330.623013:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789127330.623064:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789464064 00000100:00100000:1.0:1789127330.623068:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789464064 00000100:00100000:1.0:1789127330.623091:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789127330.623097:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789464064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127330.623144:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789127330.623182:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789464064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127330.623188:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1789127330.623225:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca4f00 x1876035789464192/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127330.623243:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789464192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127330.623258:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127330.623265:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789464320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127330.623292:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127330.623318:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789464320 00000100:00100000:1.0:1789127330.623322:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789464320 00000100:00100000:1.0:1789127330.623343:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789127330.623349:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789464320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789127330.623358:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127330.623385:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789464320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127330.623391:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789127330.623427:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345884a3840 x1876035789464320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127330.623440:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789464320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127330.623470:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789464064:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789127330.743731:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127330.815353:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127330.815400:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127330.815461:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127330.815498:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127330.815586:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127330.815626:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771571968 00000100:00100000:0.0:1789127330.815636:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771571968 00000100:00100000:2.0:1789127330.815671:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771572096 00000100:00100000:2.0:1789127330.815675:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771572096 00000100:00100000:3.0:1789127330.815697:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771572352 00000100:00100000:0.0:1789127330.815703:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 280 00000100:00100000:3.0:1789127330.815705:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771572352 00000100:00100000:0.0:1789127330.815715:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2400:x1876035771571968:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127330.815716:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771572224 00000100:00100000:2.0:1789127330.815720:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771572224 00000100:00100000:3.0:1789127330.815748:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771572480 00000100:00100000:2.0:1789127330.815753:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:3.0:1789127330.815754:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771572480 00000100:00100000:2.0:1789127330.815762:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2400:x1876035771572096:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127330.815790:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:2.0:1789127330.815794:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2400:x1876035771572096:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 33us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127330.815794:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2400:x1876035771571968:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 80us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127330.815804:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771572352:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127330.815805:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 280 00000100:00100000:2.0:1789127330.815809:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:2.0:1789127330.815826:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 89 00000100:00100000:2.0:1789127330.815834:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587839e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771572224:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127330.815846:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771572352:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 46us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127330.815877:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587839e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771572224:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 44us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127330.815883:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 89 00000100:00100000:2.0:1789127330.815905:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:2.0:1789127330.815912:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771572480:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127330.815936:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771572480:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127330.815942:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00080000:2.0:1789127330.815958:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127330.815962:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127330.815964:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127330.815966:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127330.816309:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:2.0:1789127331.128355:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789464448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127331.128430:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127331.128799:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789464448 00000100:00100000:0.0:1789127331.128807:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789464448 00000100:00100000:0.0:1789127331.128870:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789127331.128879:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789464448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127331.128906:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127331.128953:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789464448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127331.128960:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1789127331.129008:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7ebda40 x1876035789464448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127331.129025:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789464448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127331.129308:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458783b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789464576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789127331.129341:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127331.129374:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789464576 00000100:00100000:1.0:1789127331.129378:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789464576 00000100:00100000:1.0:1789127331.129397:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789127331.129403:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7390780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789464576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127331.129412:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127331.129441:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7390780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789464576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127331.129448:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789127331.129471:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93458783b840 x1876035789464576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127331.129485:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458783b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789464576:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789127331.774771:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127332.792719:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789127333.462490:0:10945:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing yml_node 00010000:00010000:0.0:1789127333.816019:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127334.839761:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127335.223761:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127335.223784:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458783b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789464704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127335.223875:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127335.224422:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789464704 00000100:00100000:1.0:1789127335.224430:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789464704 00000100:00100000:1.0:1789127335.224480:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789127335.224488:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789464704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127335.224536:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789127335.224589:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789464704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127335.224596:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789127335.227308:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458783b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789464704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127335.735732:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458783b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789464960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127335.735801:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127335.735872:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789465472:0@lo:400:kworker.0 00000100:00100000:0.0:1789127335.735897:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127335.735916:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789465984:0@lo:400:kworker.0 00000100:00100000:0.0:1789127335.735941:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127335.735967:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789127335.735972:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789465088:0@lo:400:kworker.0 00000100:00100000:1.0:1789127335.735993:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789464960 00000100:00100000:0.0:1789127335.735998:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127335.736000:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789464960 00000100:00100000:0.0:1789127335.736015:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789465600:0@lo:400:kworker.0 00000100:00100000:1.0:1789127335.736052:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127335.736052:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127335.736061:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789464960:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127335.736066:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789466112:0@lo:400:kworker.0 00000100:00100000:0.0:1789127335.736084:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:1.0:1789127335.736088:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127335.736105:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789465216:0@lo:400:kworker.0 00000100:00100000:0.0:1789127335.736125:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127335.736132:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789464960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127335.736136:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789465728:0@lo:400:kworker.0 00000100:00100000:1.0:1789127335.736139:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789127335.736159:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789465984 00000100:00100000:1.0:1789127335.736163:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789465984 00000100:00100000:0.0:1789127335.736163:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127335.736180:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789466240:0@lo:400:kworker.0 00000100:00100000:1.0:1789127335.736185:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789127335.736190:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346bf8bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789465984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127335.736200:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127335.736213:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789127335.736216:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346bf8bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789465984:12345-0@lo:400:kworker.0 Request processed in 27us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127335.736217:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789464832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127335.736223:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789127335.736236:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127335.736250:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789465344:0@lo:400:kworker.0 00000100:00100000:0.0:1789127335.736267:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127335.736274:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789465856:0@lo:400:kworker.0 00000100:00100000:0.0:1789127335.736289:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127335.736300:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789466368:0@lo:400:kworker.0 00000100:00100000:0.0:1789127335.736314:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127335.736334:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789465472 00000100:00100000:0.0:1789127335.736339:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789465472 00000100:00100000:1.0:1789127335.736348:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789465856 00000100:00100000:1.0:1789127335.736350:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789465856 00000100:00100000:1.0:1789127335.736367:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789466368 00000100:00100000:1.0:1789127335.736369:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789466368 00000100:00100000:0.0:1789127335.736372:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789127335.736381:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127335.736384:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789465472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127335.736385:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789465856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127335.736414:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789465472:12345-0@lo:400:kworker.0 Request processed in 31us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127335.736421:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789127335.736429:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789465856:12345-0@lo:400:kworker.0 Request processed in 44us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127335.736435:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789127335.736445:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789127335.736450:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789466368:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789127335.736459:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e86580 x1876035789465856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127335.736474:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e892c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789466368:12345-0@lo:400:kworker.0 Request processed in 24us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127335.736474:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e86580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789465856:0@lo:400:kworker.0 00000100:00100000:1.0:1789127335.736479:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1789127335.736484:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e852c0 x1876035789466368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127335.736491:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789466368:0@lo:400:kworker.0 00000100:00080000:1.0:1789127335.736500:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789127335.736504:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127335.736530:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789464832 00000100:00100000:1.0:1789127335.736534:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789464832 00000100:00100000:1.0:1789127335.736550:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789127335.736553:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789465472:0@lo:400:kworker.0 00000100:00100000:1.0:1789127335.736556:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789464832:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789127335.736562:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e870c0 x1876035789465984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1789127335.736566:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127335.736570:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789465984:0@lo:400:kworker.0 00010000:00080000:0.0:1789127335.736580:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93458783b840 x1876035789464960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127335.736592:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458783b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789464960:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127335.736596:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789464832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127335.736601:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789127335.736622:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca4f00 x1876035789464832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127335.736633:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789464832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127335.736957:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789465088 00000100:00100000:3.0:1789127335.736961:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127335.736961:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789465088 00000100:00100000:3.0:1789127335.736971:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789466496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127335.736988:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789127335.736993:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789465088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127335.737001:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127335.737029:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789466496 00000100:00100000:3.0:1789127335.737033:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789466496 00000100:00100000:3.0:1789127335.737057:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789127335.737064:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789466496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127335.737090:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789127335.737127:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789466496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127335.737134:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789127335.737281:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789465600 00000100:00100000:0.0:1789127335.737286:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789465600 00000100:00100000:3.0:1789127335.737297:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789466496:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127335.737310:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789466112 00000100:00100000:0.0:1789127335.737312:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789466112 00000100:00100000:0.0:1789127335.737323:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789465216 00000100:00100000:0.0:1789127335.737325:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789465216 00000100:00100000:0.0:1789127335.737334:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789465728 00000100:00100000:0.0:1789127335.737342:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789465728 00000100:00100000:0.0:1789127335.737372:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789466240 00000100:00100000:0.0:1789127335.737375:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789466240 00000100:00100000:0.0:1789127335.737387:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789465344 00000100:00100000:0.0:1789127335.737390:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789465344 00000100:00100000:0.0:1789127335.737403:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789127335.737409:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789465600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127335.737441:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789127335.737443:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789465600:12345-0@lo:400:kworker.0 Request processed in 35us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127335.737448:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789466112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127335.737449:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789127335.737461:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789127335.737466:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789465216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127335.737477:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789466112:12345-0@lo:400:kworker.0 Request processed in 30us (1392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127335.737483:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789127335.737490:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789465216:12345-0@lo:400:kworker.0 Request processed in 25us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127335.737495:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789127335.737504:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789127335.737534:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789465728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127335.737563:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789127335.737563:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e88b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789465728:12345-0@lo:400:kworker.0 Request processed in 53us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127335.737568:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789127335.737569:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789466240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127335.737579:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789127335.737584:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789465344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127335.737597:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789466240:12345-0@lo:400:kworker.0 Request processed in 28us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127335.737602:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789127335.737605:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e89a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789465344:12345-0@lo:400:kworker.0 Request processed in 22us (1338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127335.737610:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789127335.737689:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789465088:12345-0@lo:400:kworker.0 Request processed in 694us (1688us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127335.737696:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:1.0:1789127335.738602:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127335.738609:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127335.738646:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789465344:0@lo:400:kworker.0 00000100:00100000:1.0:1789127335.738661:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789465216:0@lo:400:kworker.0 00010000:00080000:1.0:1789127335.738673:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e84b40 x1876035789465728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127335.738683:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789465728:0@lo:400:kworker.0 00010000:00080000:1.0:1789127335.738693:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e861c0 x1876035789466240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127335.738702:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789466240:0@lo:400:kworker.0 00000100:00100000:1.0:1789127335.739237:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789465088:0@lo:400:kworker.0 00000100:00100000:1.0:1789127335.739270:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789465600:0@lo:400:kworker.0 00000100:00100000:1.0:1789127335.739281:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789466112:0@lo:400:kworker.0 00010000:00010000:3.0:1789127335.864493:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127335.943681:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127335.943742:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127335.943813:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127335.944294:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771572608 00000100:00100000:1.0:1789127335.944304:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771572608 00000100:00100000:1.0:1789127335.944359:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 282 00000100:00100000:1.0:1789127335.944369:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2400:x1876035771572608:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127335.944443:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2400:x1876035771572608:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 75us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127335.944451:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 282 00000100:00100000:2.0:1789127335.945949:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771572864 00000100:00100000:2.0:1789127335.945961:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771572864 00000100:00080000:1.0:1789127335.946132:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127335.946985:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771572736 00000100:00100000:3.0:1789127335.947003:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771572736 00000100:00080000:1.0:1789127335.947108:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127335.947359:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 96 00000100:00100000:2.0:1789127335.947378:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771572864:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127335.947459:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771572864:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 90us (3715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127335.947467:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 96 00000100:00100000:3.0:1789127335.948025:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:3.0:1789127335.948042:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2400:x1876035771572736:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127335.948613:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2400:x1876035771572736:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 109us (4330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127335.950158:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:1.0:1789127335.958086:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127335.958142:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127335.958230:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771572992 00000100:00100000:2.0:1789127335.958240:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771572992 00000100:00100000:2.0:1789127335.958308:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771573120 00000100:00100000:2.0:1789127335.958312:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771573120 00000100:00100000:2.0:1789127335.958334:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:2.0:1789127335.958343:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2398:x1876035771572992:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:2.0:1789127335.958379:0:10363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d551 00000100:00080000:2.0:1789127335.958389:0:10363:0:(import.c:65:import_set_state_nolock()) ffff934586075000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789127335.958428:0:10363:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789127335.958591:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e85a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+2:2398:x1876035771572992:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 248us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127335.958600:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:2.0:1789127335.958616:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:2.0:1789127335.958623:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2398:x1876035771573120:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:2.0:1789127335.958637:0:10363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d558 00000100:00080000:2.0:1789127335.958642:0:10363:0:(import.c:65:import_set_state_nolock()) ffff9346aecbe800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789127335.958662:0:10363:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789127335.958741:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+2:2398:x1876035771573120:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 117us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127335.958748:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00010000:00010000:0.0:1789127335.959113:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127335.959126:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789127335.960079:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127335.960086:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127336.247833:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127336.247860:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789466624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127336.247944:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127336.248275:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789466624 00000100:00100000:1.0:1789127336.248283:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789466624 00000100:00100000:1.0:1789127336.248337:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789127336.248348:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789466624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127336.248377:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127336.248430:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789466624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127336.248437:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789127336.248475:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e861c0 x1876035789466624/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127336.248492:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789466624:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127336.249339:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127336.249352:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789466752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127336.249393:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127336.249473:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789466752 00000100:00100000:1.0:1789127336.249479:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789466752 00000100:00100000:1.0:1789127336.249533:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789127336.249541:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789466752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127336.249556:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127336.249591:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789466752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127336.249599:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1789127336.249670:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7ebd680 x1876035789466752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127336.249686:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789466752:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789127336.890067:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789127337.890750:0:11129:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.135 00010000:00010000:0.0:1789127337.911659:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127338.942489:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127339.960983:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789127340.082826:0:11226:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.135 00000100:00100000:2.0:1789127340.343895:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789466880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127340.343964:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127340.344013:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789466880 00000100:00100000:1.0:1789127340.344020:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789466880 00000100:00100000:1.0:1789127340.344071:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789127340.344081:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789466880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127340.344115:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789127340.344169:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789466880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127340.344177:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789127340.344202:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e883c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789466880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127340.855781:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789467008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127340.855864:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127340.855936:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789467008 00000100:00100000:1.0:1789127340.855943:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789467008 00000100:00100000:1.0:1789127340.855991:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789127340.856000:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789467008:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789127340.856028:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127340.856069:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789467008:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127340.856077:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1789127340.856104:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127340.856417:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789467264:0@lo:400:kworker.0 00000100:00100000:0.0:1789127340.856453:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127340.856696:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789467136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127340.856727:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127340.856776:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127340.856782:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789467520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127340.856824:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127340.856850:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789467520 00000100:00100000:3.0:1789127340.856855:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789467520 00000100:00100000:3.0:1789127340.856887:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789127340.856895:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789467520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127340.856918:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789127340.856951:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789467520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127340.856957:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789127340.856995:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789467520:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127340.857018:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789467136 00000100:00100000:3.0:1789127340.857021:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789467136 00000100:00100000:3.0:1789127340.857047:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789127340.857053:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789467136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127340.857064:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127340.857094:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789467136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127340.857100:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789127340.857113:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789127340.857142:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e89680 x1876035789467136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127340.857155:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789467136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127340.857200:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789467392:0@lo:400:kworker.0 00000100:00100000:3.0:1789127340.857228:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789127340.857441:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e861c0 x1876035789467008/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127356 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127340.857456:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789467008:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127340.857486:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789467264 00000100:00100000:1.0:1789127340.857490:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789467264 00000100:00100000:1.0:1789127340.857546:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789127340.857553:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789467264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.861339:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586044b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789467904:0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.861404:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127340.861434:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345860461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789468416:0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.861455:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127340.861481:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789127340.861487:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789467776:0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.861536:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127340.861555:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586046d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789468288:0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.861580:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127340.861609:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789467392 00000100:00100000:2.0:1789127340.861616:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789467392 00000100:00100000:2.0:1789127340.861664:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789467904 00000100:00100000:2.0:1789127340.861668:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789467904 00000100:00100000:2.0:1789127340.861692:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789468416 00000100:00100000:2.0:1789127340.861695:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789468416 00000100:00100000:2.0:1789127340.861708:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789467776 00000100:00100000:2.0:1789127340.861710:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789467776 00000100:00100000:2.0:1789127340.861725:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789127340.861733:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789467392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.861785:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789467392:12345-0@lo:400:kworker.0 Request processed in 52us (4555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127340.861815:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789127340.861832:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789127340.861839:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789467904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.861870:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789467904:12345-0@lo:400:kworker.0 Request processed in 32us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127340.861877:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789127340.861888:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789127340.861895:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b738a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789468416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.861922:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b738a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789468416:12345-0@lo:400:kworker.0 Request processed in 28us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127340.861928:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789127340.861940:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789127340.861946:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789467776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.861972:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789467776:12345-0@lo:400:kworker.0 Request processed in 27us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127340.861978:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789127340.862000:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789468288 00000100:00100000:2.0:1789127340.862004:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789468288 00000100:00100000:2.0:1789127340.862031:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789127340.862038:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b738a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789468288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.862068:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b738a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789468288:12345-0@lo:400:kworker.0 Request processed in 32us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127340.862074:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789127340.862093:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127340.862098:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127340.862134:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789467776:0@lo:400:kworker.0 00010000:00080000:2.0:1789127340.862149:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934586046d00 x1876035789468288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127340.862159:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586046d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789468288:0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.862169:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586044b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789467904:0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.862178:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345860461c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789468416:0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.862189:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789467392:0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.862220:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789467648:0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.862249:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127340.862269:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789468160:0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.862289:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127340.862308:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789127340.862314:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586046580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789468032:0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.862334:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127340.862351:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586044780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789468544:0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.862371:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127340.862391:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789467648 00000100:00100000:2.0:1789127340.862395:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789467648 00000100:00100000:2.0:1789127340.862419:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789127340.862425:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b738b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789467648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.862460:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b738b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789467648:12345-0@lo:400:kworker.0 Request processed in 36us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127340.862466:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789127340.862489:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789468032 00000100:00100000:2.0:1789127340.862493:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789468032 00000100:00100000:2.0:1789127340.862538:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789468544 00000100:00100000:2.0:1789127340.862542:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789468544 00000100:00100000:2.0:1789127340.862556:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789127340.862561:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b738bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789468032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.862590:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b738bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789468032:12345-0@lo:400:kworker.0 Request processed in 29us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127340.862596:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789127340.862606:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789127340.862611:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7389680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789468544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.862632:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7389680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789468544:12345-0@lo:400:kworker.0 Request processed in 21us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127340.862638:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:2.0:1789127340.862649:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789127340.862675:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934586046580 x1876035789468032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127340.862685:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586046580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789468032:0@lo:400:kworker.0 00010000:00080000:2.0:1789127340.862696:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934586044780 x1876035789468544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127340.862704:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586044780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789468544:0@lo:400:kworker.0 00000100:00100000:2.0:1789127340.862714:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789467648:0@lo:400:kworker.0 00000100:00100000:1.0:1789127340.864230:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789467264:12345-0@lo:400:kworker.0 Request processed in 6671us (7770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127340.864241:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789127340.864313:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789468160 00000100:00100000:1.0:1789127340.864319:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789468160 00000100:00100000:1.0:1789127340.864404:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789127340.864413:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7389a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789468160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127340.864469:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7389a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789468160:12345-0@lo:400:kworker.0 Request processed in 57us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127340.864475:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1789127340.864526:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934586047c00 x1876035789468160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127340.864539:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789468160:0@lo:400:kworker.0 00000100:00100000:0.0:1789127340.864637:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789467264:0@lo:400:kworker.0 00000100:00080000:3.0:1789127340.867232:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789127340.984340:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127341.058945:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127341.058993:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127341.059039:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127341.059110:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771573504 00000100:00100000:3.0:1789127341.059120:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771573504 00000100:00100000:3.0:1789127341.059184:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771573376 00000100:00100000:3.0:1789127341.059188:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771573376 00000100:00100000:3.0:1789127341.059210:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 104 00000100:00100000:3.0:1789127341.059220:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771573504:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127341.059234:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 105 00000100:00100000:1.0:1789127341.059247:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771573376:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127341.059291:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e88f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771573376:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 48us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127341.059297:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771573504:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 77us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127341.059307:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 104 00000100:00100000:1.0:1789127341.059318:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 105 00000100:00100000:2.0:1789127341.059412:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771573248 00000100:00100000:2.0:1789127341.059417:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771573248 00000100:00100000:2.0:1789127341.059462:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 284 00000100:00100000:2.0:1789127341.059470:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2401:x1876035771573248:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127341.059701:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2401:x1876035771573248:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 39us (574us total) trans 0 rc 0/0 00000100:00080000:0.0:1789127341.059708:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127341.059710:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 284 00000100:00080000:0.0:1789127341.059714:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127341.369189:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789468672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127341.369259:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127341.369548:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789468672 00000100:00100000:3.0:1789127341.369556:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789468672 00000100:00100000:3.0:1789127341.369688:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789127341.369699:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7389e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789468672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127341.369726:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127341.369788:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7389e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789468672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127341.369806:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789127341.369951:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789468800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127341.369987:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127341.370083:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789468800 00000100:00100000:2.0:1789127341.370088:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789468800 00000100:00100000:2.0:1789127341.370125:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789127341.370133:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789468800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789127341.370144:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127341.370185:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e88780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789468800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127341.370192:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789127341.370274:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7ebc780 x1876035789468672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127341.370293:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789468672:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789127341.370413:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e8b480 x1876035789468800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127341.370425:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789468800:0@lo:13:osp-pre-0-1.0 00000001:00100000:0.0:1789127341.884838:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000020:00000080:0.0:1789127341.884860:0:9519:0:(genops.c:885:class_export_put()) final put ffff934586070800/2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000020:00000080:2.0:1789127341.885102:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff934586070800/2eecd753-97f2-4dc9-9442-17e5ef8fda22 for lustre-OST0001 00000020:00000080:2.0:1789127341.885152:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346aecbe800 for lustre-OST0001 00000001:00100000:1.0:1789127341.887146:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000020:00000080:1.0:1789127341.887155:0:8433:0:(genops.c:885:class_export_put()) final put ffff934586073000/2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000020:00000080:2.0:1789127341.887241:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff934586073000/2eecd753-97f2-4dc9-9442-17e5ef8fda22 for lustre-OST0000 00000020:00000080:2.0:1789127341.887276:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934586075000 for lustre-OST0000 00010000:00010000:0.0:1789127342.008085:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789127342.368111:0:11323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.135 00010000:00010000:3.0:1789127343.031826:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789127344.000836:0:11372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 07:49:01 EDT 2026 00010000:00010000:0.0:1789127344.055688:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127345.079723:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127345.466555:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127345.466578:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789468928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127345.466642:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127345.466701:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789468928 00000100:00100000:0.0:1789127345.466708:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789468928 00000100:00100000:0.0:1789127345.466751:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789127345.466759:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789468928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127345.466802:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789127345.466843:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789468928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127345.466851:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789127345.466896:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e89680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789468928:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127345.983847:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789469056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127345.983922:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127345.983993:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789469056 00000100:00100000:2.0:1789127345.984000:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789469056 00000100:00100000:2.0:1789127345.984054:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789127345.984065:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586044780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789469056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127345.984093:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127345.984145:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586044780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789469056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127345.984153:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1789127345.984175:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789127345.984201:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934586047c00 x1876035789469056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127345.984221:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789469056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127345.985343:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789469312:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.985390:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127345.985427:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789469824:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.985540:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127345.985565:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789470336:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.985589:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127345.985611:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789127345.985876:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789469440:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.985904:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127345.985925:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789469952:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.985945:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127345.985961:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789470464:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.985981:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127345.987597:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789469824 00000100:00100000:2.0:1789127345.987605:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789469824 00000100:00100000:2.0:1789127345.987659:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789127345.987668:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586047c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789469824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.987728:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586047c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789469824:12345-0@lo:400:kworker.0 Request processed in 62us (2188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127345.987740:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789127345.987885:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789469568:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.987922:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127345.987943:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789470080:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.987966:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127345.987982:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7395e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789470592:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.988002:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127345.988017:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1789127345.988023:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789469184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127345.988044:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127345.988061:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789469696:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.988082:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127345.988092:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789470208:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.988115:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127345.988132:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789470720:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.988151:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127345.988177:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789470336 00000100:00100000:2.0:1789127345.988181:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789470336 00000100:00100000:2.0:1789127345.988218:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789470208 00000100:00100000:2.0:1789127345.988221:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789470208 00000100:00100000:2.0:1789127345.988238:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789470720 00000100:00100000:2.0:1789127345.988241:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789470720 00000100:00100000:2.0:1789127345.988257:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789127345.988263:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586046580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789470336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.988296:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586046580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789470336:12345-0@lo:400:kworker.0 Request processed in 34us (2706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127345.988307:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789127345.988320:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127345.988325:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789470208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.988359:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789470208:12345-0@lo:400:kworker.0 Request processed in 33us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127345.988365:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127345.988376:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789127345.988382:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789470720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.988407:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789470720:12345-0@lo:400:kworker.0 Request processed in 26us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127345.988413:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1789127345.988430:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127345.988433:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127345.988439:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789469568 00000100:00100000:2.0:1789127345.988441:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789469568 00000100:00100000:1.0:1789127345.988718:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789469312 00000100:00100000:1.0:1789127345.988722:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789469312 00000100:00100000:1.0:1789127345.988749:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789127345.988755:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789469312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.988896:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789469184 00000100:00100000:2.0:1789127345.988900:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789469184 00000100:00100000:2.0:1789127345.988909:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789127345.988914:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789469568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127345.989008:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789469440 00000100:00100000:3.0:1789127345.989012:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789469440 00000100:00100000:3.0:1789127345.989030:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789469952 00000100:00100000:3.0:1789127345.989032:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789469952 00000100:00100000:3.0:1789127345.989048:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789470464 00000100:00100000:3.0:1789127345.989050:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789470464 00000100:00100000:3.0:1789127345.989061:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789470080 00000100:00100000:3.0:1789127345.989071:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789470080 00000100:00100000:3.0:1789127345.989086:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789470592 00000100:00100000:3.0:1789127345.989089:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789470592 00000100:00100000:3.0:1789127345.989100:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789469696 00000100:00100000:3.0:1789127345.989102:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789469696 00000100:00100000:3.0:1789127345.989114:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789127345.989120:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345860461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789469440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.990852:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789469568:12345-0@lo:400:kworker.0 Request processed in 1930us (2922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127345.990864:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789127345.990894:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789127345.990903:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789469184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789127345.990931:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789127345.990959:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789469184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127345.990971:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789127345.991020:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789469824:0@lo:400:kworker.0 00010000:00080000:2.0:1789127345.991034:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7396580 x1876035789470336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127345.991044:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789470336:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.991083:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789469184:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1789127345.991097:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7397c00 x1876035789470208/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127345.991107:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789470208:0@lo:400:kworker.0 00010000:00080000:2.0:1789127345.991118:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73961c0 x1876035789470720/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127345.991126:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789470720:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.991136:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789469568:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.991186:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789127345.991196:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586044b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789469952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.991240:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586044b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789469952:12345-0@lo:400:kworker.0 Request processed in 46us (5294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127345.991247:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789127345.991262:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789127345.991269:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789470464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.991299:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586046d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789470464:12345-0@lo:400:kworker.0 Request processed in 31us (5317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127345.991311:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789127345.991324:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789127345.991330:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789470080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.991366:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789470080:12345-0@lo:400:kworker.0 Request processed in 37us (3400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127345.991371:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789127345.991384:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789127345.991391:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789470592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.991419:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789470592:12345-0@lo:400:kworker.0 Request processed in 29us (3416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127345.991425:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789127345.991437:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789127345.991443:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789469696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.991472:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789469696:12345-0@lo:400:kworker.0 Request processed in 29us (3388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127345.991477:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789127345.991533:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789469952:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.991545:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789470464:0@lo:400:kworker.0 00000100:00100000:2.0:1789127345.991566:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789469696:0@lo:400:kworker.0 00010000:00080000:2.0:1789127345.991576:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7ebc780 x1876035789470080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127345.991585:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789470080:0@lo:400:kworker.0 00010000:00080000:2.0:1789127345.991606:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7395e00 x1876035789470592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127345.991615:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7395e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789470592:0@lo:400:kworker.0 00000100:00080000:2.0:1789127345.991654:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127345.991658:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127345.993930:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789469312:12345-0@lo:400:kworker.0 Request processed in 5168us (8533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127345.993943:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789127345.994036:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127345.994052:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789470848:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127345.994087:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127345.994122:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789470848 00000100:00100000:1.0:1789127345.994129:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789470848 00000100:00100000:1.0:1789127345.994165:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789127345.994173:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789470848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789127345.994191:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127345.994228:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e87840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789470848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127345.994234:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789127345.994266:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e87c00 x1876035789470848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127361 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127345.994293:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789470848:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127345.994362:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789469312:0@lo:400:kworker.0 00000100:00100000:3.0:1789127345.996860:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345860461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789469440:12345-0@lo:400:kworker.0 Request processed in 7732us (10947us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127345.996872:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789127346.002962:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789469440:0@lo:400:kworker.0 00010000:00010000:3.0:1789127346.106802:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127346.172674:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127346.172722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127346.172806:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127346.172835:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771573632 00000100:00100000:2.0:1789127346.172843:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771573632 00000100:00100000:2.0:1789127346.172903:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 286 00000100:00100000:2.0:1789127346.172915:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2402:x1876035771573632:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127346.172983:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2402:x1876035771573632:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 70us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127346.173004:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 286 00000100:00100000:2.0:1789127346.173036:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771573760 00000100:00100000:2.0:1789127346.173039:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771573760 00000100:00100000:2.0:1789127346.173073:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771573888 00000100:00100000:2.0:1789127346.173076:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771573888 00000100:00100000:2.0:1789127346.173098:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:2.0:1789127346.173105:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771573760:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127346.173136:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771573760:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 32us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127346.173143:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:2.0:1789127346.173154:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:2.0:1789127346.173160:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771573888:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127346.173201:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771573888:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 41us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127346.173208:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00080000:2.0:1789127346.173291:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127346.173295:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127346.487838:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127346.487862:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789470976:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127346.487935:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127346.488017:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789470976 00000100:00100000:0.0:1789127346.488024:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789470976 00000100:00100000:0.0:1789127346.488067:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789127346.488076:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789470976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789127346.488125:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127346.488170:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e89680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789470976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127346.488177:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1789127346.488671:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e89e00 x1876035789470976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127346.488690:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789470976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127346.488909:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7395680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789471104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127346.488946:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127346.489071:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789471104 00000100:00100000:1.0:1789127346.489076:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789471104 00000100:00100000:1.0:1789127346.489116:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789127346.489124:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789471104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127346.489139:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127346.489190:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789471104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127346.489197:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1789127346.489367:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7395680 x1876035789471104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127346.489381:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7395680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789471104:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789127347.131872:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127348.153481:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127349.175647:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127350.200710:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127350.590151:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7395680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789471232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127350.590225:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127350.595003:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789471232 00000100:00100000:3.0:1789127350.595016:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789471232 00000100:00100000:3.0:1789127350.595067:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789127350.595078:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789471232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127350.595116:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789127350.595196:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789471232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (4970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127350.595203:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789127350.595250:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7395680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789471232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127351.097893:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7395680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789471360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127351.097981:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127351.098052:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789471360 00000100:00100000:3.0:1789127351.098059:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789471360 00000100:00100000:3.0:1789127351.098098:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789127351.098108:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789471360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127351.098139:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789127351.098181:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789471360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127351.098188:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789127351.098231:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7395680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789471360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127351.098683:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7395680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789471488:0@lo:400:kworker.0 00000100:00100000:3.0:1789127351.098718:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127351.099978:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7395e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789471616:0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.100030:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127351.100071:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789472128:0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.100093:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127351.100108:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789472640:0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.100128:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127351.100155:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789127351.100163:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789471744:0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.100188:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127351.100205:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789472256:0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.100226:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127351.100242:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789472768:0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.100262:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127351.100290:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789471872:0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.100315:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127351.100333:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789472384:0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.100370:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127351.100396:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789472896:0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.100417:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127351.100435:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127351.100440:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789473024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127351.100462:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127351.100490:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789471616 00000100:00100000:2.0:1789127351.100496:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789471616 00000100:00100000:2.0:1789127351.100556:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789472128 00000100:00100000:2.0:1789127351.100560:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789472128 00000100:00100000:2.0:1789127351.100581:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789472640 00000100:00100000:2.0:1789127351.100584:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789472640 00000100:00100000:2.0:1789127351.100595:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789471872 00000100:00100000:2.0:1789127351.100597:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789471872 00000100:00100000:2.0:1789127351.100610:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789127351.100617:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789471616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.100668:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789471616:12345-0@lo:400:kworker.0 Request processed in 51us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127351.100675:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789127351.100691:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789127351.100697:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789472128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.100728:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789472128:12345-0@lo:400:kworker.0 Request processed in 32us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127351.100734:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789127351.101887:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789127351.101904:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789472640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.101961:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789472640:12345-0@lo:400:kworker.0 Request processed in 64us (1832us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127351.101969:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789127351.102006:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789127351.102012:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789471872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.102054:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789471872:12345-0@lo:400:kworker.0 Request processed in 42us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127351.102060:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789127351.102089:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789471744 00000100:00100000:2.0:1789127351.102095:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789471744 00000100:00100000:2.0:1789127351.102128:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789127351.102134:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789471744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.102165:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789471744:12345-0@lo:400:kworker.0 Request processed in 32us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127351.102171:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789127351.102188:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789472256 00000100:00100000:2.0:1789127351.102192:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789472256 00000100:00100000:2.0:1789127351.102220:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789472768 00000100:00100000:2.0:1789127351.102222:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789472768 00000100:00100000:2.0:1789127351.102234:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789472384 00000100:00100000:2.0:1789127351.102237:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789472384 00000100:00100000:2.0:1789127351.102248:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789472896 00000100:00100000:2.0:1789127351.102250:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789472896 00000100:00100000:2.0:1789127351.102263:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127351.102269:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789472256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.102300:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789472256:12345-0@lo:400:kworker.0 Request processed in 31us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127351.102304:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127351.102314:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789127351.102320:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789472768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.102347:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789472768:12345-0@lo:400:kworker.0 Request processed in 28us (2085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127351.102361:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789127351.102373:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789127351.102379:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789472384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.102412:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789472384:12345-0@lo:400:kworker.0 Request processed in 34us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127351.102418:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789127351.102428:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789127351.102434:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789472896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.102461:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789472896:12345-0@lo:400:kworker.0 Request processed in 27us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127351.102467:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789127351.102494:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789473024 00000100:00100000:2.0:1789127351.102497:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789473024 00000100:00100000:2.0:1789127351.102543:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789127351.102550:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789473024:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127351.102573:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127351.102602:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789473024:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (2139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127351.102608:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789127351.102625:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127351.102628:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127351.102631:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127351.102665:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789471744:0@lo:400:kworker.0 00010000:00080000:2.0:1789127351.102680:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878cda40 x1876035789472256/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127351.102704:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789472256:0@lo:400:kworker.0 00010000:00080000:2.0:1789127351.102717:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878ced00 x1876035789472768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127351.102725:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789472768:0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.103114:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7395e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789471616:0@lo:400:kworker.0 00010000:00080000:2.0:1789127351.103135:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7396580 x1876035789472128/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127351.103145:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789472128:0@lo:400:kworker.0 00010000:00080000:2.0:1789127351.103155:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878ccf00 x1876035789472640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127351.103163:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789472640:0@lo:400:kworker.0 00010000:00080000:2.0:1789127351.103209:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e843c0 x1876035789473024/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127351.103224:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789473024:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127351.103235:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789471872:0@lo:400:kworker.0 00010000:00080000:2.0:1789127351.103244:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878cf480 x1876035789472384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127351.103252:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789472384:0@lo:400:kworker.0 00010000:00080000:2.0:1789127351.103262:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b08780 x1876035789472896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127351.103282:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789472896:0@lo:400:kworker.0 00000100:00100000:0.0:1789127351.103960:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789473152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127351.104009:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127351.104054:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789473152 00000100:00100000:0.0:1789127351.104059:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789473152 00000100:00100000:0.0:1789127351.104092:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789127351.104100:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789473152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127351.104115:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127351.104150:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e88000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789473152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127351.104157:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1789127351.104187:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e8b480 x1876035789473152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127351.104200:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789473152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127351.105248:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789472000:0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.105290:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127351.105317:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789472512:0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.105340:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127351.105376:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789472000 00000100:00100000:2.0:1789127351.105382:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789472000 00000100:00100000:2.0:1789127351.105420:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789472512 00000100:00100000:2.0:1789127351.105423:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789472512 00000100:00100000:2.0:1789127351.105444:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789127351.105451:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789472000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.105493:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789472000:12345-0@lo:400:kworker.0 Request processed in 42us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127351.105501:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789127351.105540:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789127351.105546:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789472512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.105573:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789472512:12345-0@lo:400:kworker.0 Request processed in 28us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127351.105579:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:2.0:1789127351.105594:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127351.105637:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789472000:0@lo:400:kworker.0 00000100:00100000:2.0:1789127351.105646:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789472512:0@lo:400:kworker.0 00000100:00100000:0.0:1789127351.105723:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789471488 00000100:00100000:0.0:1789127351.105728:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789471488 00000100:00100000:0.0:1789127351.105777:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789127351.105784:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789471488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127351.105822:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789471488:12345-0@lo:400:kworker.0 Request processed in 40us (7104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127351.105828:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1789127351.105875:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7395680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789471488:0@lo:400:kworker.0 00010000:00010000:1.0:1789127351.227709:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127351.294137:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127351.294182:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127351.294212:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127351.294238:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771574016 00000100:00100000:3.0:1789127351.294247:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771574016 00000100:00100000:3.0:1789127351.294294:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 288 00000100:00100000:3.0:1789127351.294304:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2400:x1876035771574016:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127351.294366:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2400:x1876035771574016:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 63us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127351.294373:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 288 00000100:00100000:2.0:1789127351.294460:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771574144 00000100:00100000:2.0:1789127351.294465:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771574144 00000100:00100000:2.0:1789127351.294553:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771574272 00000100:00100000:2.0:1789127351.294557:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771574272 00000100:00100000:2.0:1789127351.294580:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:2.0:1789127351.294587:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2400:x1876035771574144:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127351.294620:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2400:x1876035771574144:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 34us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127351.294627:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:2.0:1789127351.294640:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:2.0:1789127351.294647:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771574272:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127351.294670:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771574272:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 24us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127351.294676:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00080000:3.0:1789127351.295763:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789127351.295770:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127351.608074:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789473280:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789127351.608140:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127351.608533:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789473280 00000100:00100000:0.0:1789127351.608540:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789473280 00000100:00100000:0.0:1789127351.608582:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789127351.608590:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789473280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789127351.608615:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127351.608653:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e85680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789473280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127351.608660:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:1.0:1789127351.608828:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e8b480 x1876035789473280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127351.608845:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789473280:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127351.608904:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789473408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127351.608934:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127351.609029:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789473408 00000100:00100000:3.0:1789127351.609034:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789473408 00000100:00100000:3.0:1789127351.609062:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789127351.609069:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789473408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127351.609079:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127351.609118:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789473408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127351.609123:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1789127351.609146:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e86d00 x1876035789473408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127351.609158:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789473408:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789127352.254724:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127353.273355:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127354.297320:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127355.319753:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127355.710797:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127355.710819:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789473536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127355.710898:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127355.710966:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789473536 00000100:00100000:0.0:1789127355.710973:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789473536 00000100:00100000:0.0:1789127355.711018:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789127355.711028:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789473536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127355.711059:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789127355.711102:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789473536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127355.711109:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789127355.711155:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789473536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127356.219586:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789473664:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127356.219657:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127356.219834:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789473792:0@lo:400:kworker.0 00000100:00100000:1.0:1789127356.219868:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127356.219924:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789473792 00000100:00100000:1.0:1789127356.219931:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789473792 00000100:00100000:1.0:1789127356.219973:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789127356.219982:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789473792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127356.220030:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789473792:12345-0@lo:400:kworker.0 Request processed in 49us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127356.220037:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1789127356.220084:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789473792:0@lo:400:kworker.0 00000100:00100000:2.0:1789127356.222119:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789473664 00000100:00100000:2.0:1789127356.222127:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789473664 00000100:00100000:2.0:1789127356.222175:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789127356.222183:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789473664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127356.222208:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127356.222657:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127356.222671:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789473920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127356.222709:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127356.222764:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789473920 00000100:00100000:1.0:1789127356.222768:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789473920 00000100:00100000:1.0:1789127356.222794:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789127356.222800:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789473920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127356.222821:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789127356.222850:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789473920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127356.222857:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789127356.222895:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789473920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127356.224499:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789474432:0@lo:400:kworker.0 00000100:00100000:0.0:1789127356.224568:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127356.224603:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789474944:0@lo:400:kworker.0 00000100:00100000:0.0:1789127356.224624:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127356.224643:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789127356.224648:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789474048:0@lo:400:kworker.0 00000100:00100000:0.0:1789127356.224666:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127356.224678:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789474560:0@lo:400:kworker.0 00000100:00100000:0.0:1789127356.224694:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127356.224706:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789475072:0@lo:400:kworker.0 00000100:00100000:0.0:1789127356.224960:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127356.224984:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789474432 00000100:00100000:0.0:1789127356.224991:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789474432 00000100:00100000:0.0:1789127356.225026:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789474944 00000100:00100000:0.0:1789127356.225029:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789474944 00000100:00100000:0.0:1789127356.225039:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789474048 00000100:00100000:0.0:1789127356.225040:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789474048 00000100:00100000:0.0:1789127356.225049:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789474560 00000100:00100000:0.0:1789127356.225050:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789474560 00000100:00100000:0.0:1789127356.225060:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789475072 00000100:00100000:0.0:1789127356.225062:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789475072 00000100:00100000:0.0:1789127356.225076:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789127356.225083:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789474432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127356.225132:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789474432:12345-0@lo:400:kworker.0 Request processed in 49us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127356.225139:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789127356.225153:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789127356.225159:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789474944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127356.225182:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789474944:12345-0@lo:400:kworker.0 Request processed in 24us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127356.225196:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789127356.225224:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789127356.225230:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789474048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127356.225258:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789474048:12345-0@lo:400:kworker.0 Request processed in 28us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127356.225263:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789127356.225273:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789127356.225279:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789474560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127356.225305:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789474560:12345-0@lo:400:kworker.0 Request processed in 26us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127356.225310:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789127356.225320:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789127356.225326:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789475072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127356.225348:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789475072:12345-0@lo:400:kworker.0 Request processed in 22us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127356.225353:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789127356.225395:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789474048:0@lo:400:kworker.0 00010000:00080000:0.0:1789127356.225408:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587e5c000 x1876035789474560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127356.225418:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789474560:0@lo:400:kworker.0 00010000:00080000:0.0:1789127356.225427:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587e5da40 x1876035789475072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127356.225436:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789475072:0@lo:400:kworker.0 00000100:00100000:0.0:1789127356.225454:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789474432:0@lo:400:kworker.0 00000100:00100000:0.0:1789127356.225463:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789474944:0@lo:400:kworker.0 00000100:00080000:0.0:1789127356.225902:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127356.225909:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127356.225911:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127356.225987:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789474304:0@lo:400:kworker.0 00000100:00100000:1.0:1789127356.226024:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127356.226053:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789474816:0@lo:400:kworker.0 00000100:00100000:1.0:1789127356.226076:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127356.226095:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789475328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127356.226130:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127356.226151:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789127356.226156:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789474176:0@lo:400:kworker.0 00000100:00100000:1.0:1789127356.226178:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127356.226195:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789474688:0@lo:400:kworker.0 00000100:00100000:1.0:1789127356.226232:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127356.226249:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789475200:0@lo:400:kworker.0 00000100:00100000:1.0:1789127356.226269:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127356.226297:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789474816 00000100:00100000:1.0:1789127356.226302:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789474816 00000100:00100000:1.0:1789127356.226341:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789474688 00000100:00100000:1.0:1789127356.226345:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789474688 00000100:00100000:1.0:1789127356.226362:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789475200 00000100:00100000:1.0:1789127356.226364:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789475200 00000100:00100000:1.0:1789127356.226381:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789127356.226388:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789474816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127356.226427:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e843c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789474816:12345-0@lo:400:kworker.0 Request processed in 39us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127356.226433:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789127356.226447:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789127356.226453:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789474688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127356.226481:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e84b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789474688:12345-0@lo:400:kworker.0 Request processed in 29us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127356.226487:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789127356.226498:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789127356.226503:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789475200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127356.226571:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e870c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789475200:12345-0@lo:400:kworker.0 Request processed in 68us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127356.226577:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789127356.226595:0:8442:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1789127356.226601:0:8442:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1789127356.226616:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789474176 00000100:00100000:1.0:1789127356.226620:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789474176 00000100:00100000:1.0:1789127356.226642:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789127356.226647:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789474176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127356.226677:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789474176:12345-0@lo:400:kworker.0 Request processed in 30us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127356.226682:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1789127356.226702:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127356.226705:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127356.227565:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789474304 00000100:00100000:0.0:1789127356.227573:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789474304 00000100:00100000:0.0:1789127356.227607:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789127356.227614:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789474304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127356.227656:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e86d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789474304:12345-0@lo:400:kworker.0 Request processed in 43us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127356.227663:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789127356.227892:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789474176:0@lo:400:kworker.0 00010000:00080000:1.0:1789127356.227905:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587e5cb40 x1876035789474688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127356.227914:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789474688:0@lo:400:kworker.0 00010000:00080000:1.0:1789127356.227924:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587e5e1c0 x1876035789475200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127356.227932:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789475200:0@lo:400:kworker.0 00000100:00100000:1.0:1789127356.227942:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789474304:0@lo:400:kworker.0 00010000:00080000:1.0:1789127356.227950:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587e5e580 x1876035789474816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127356.227957:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789474816:0@lo:400:kworker.0 00000100:00100000:2.0:1789127356.228388:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789473664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 6203us (8729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127356.228396:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789127356.228412:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789475328 00000100:00100000:2.0:1789127356.228417:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789475328 00000100:00100000:2.0:1789127356.228437:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789127356.228443:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789475328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127356.228469:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127356.228530:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e87c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789475328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127356.228536:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1789127356.229179:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587e5d2c0 x1876035789475328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127356.229411:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789475328:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789127356.230489:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e87480 x1876035789473664/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127356.230527:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789473664:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789127356.345615:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127356.421752:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127356.421788:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127356.421812:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127356.422016:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771574400 00000100:00100000:3.0:1789127356.422025:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771574400 00000100:00100000:3.0:1789127356.422075:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 290 00000100:00100000:3.0:1789127356.422085:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2400:x1876035771574400:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127356.422153:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2400:x1876035771574400:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 69us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127356.422161:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 290 00000100:00100000:3.0:1789127356.422194:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771574656 00000100:00100000:3.0:1789127356.422206:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771574656 00000100:00100000:3.0:1789127356.422243:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771574528 00000100:00100000:3.0:1789127356.422246:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771574528 00000100:00100000:3.0:1789127356.422269:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:3.0:1789127356.422275:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771574656:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127356.422307:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771574656:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 33us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127356.422313:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:3.0:1789127356.422325:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 129 00000100:00100000:3.0:1789127356.422332:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2400:x1876035771574528:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127356.422356:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2400:x1876035771574528:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127356.422362:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 129 00000100:00080000:1.0:1789127356.423028:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127356.423033:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127356.730743:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127356.730781:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789475456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127356.730853:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127356.730935:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789475456 00000100:00100000:2.0:1789127356.730944:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789475456 00000100:00100000:2.0:1789127356.730995:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789127356.731006:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789475456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127356.731035:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127356.731083:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789475456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127356.731091:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1789127356.731163:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e84780 x1876035789475456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127356.731181:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e84780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789475456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127356.731376:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127356.731387:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789475584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127356.731426:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127356.731534:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789475584 00000100:00100000:0.0:1789127356.731539:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789475584 00000100:00100000:0.0:1789127356.731570:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789127356.731577:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789475584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789127356.731589:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127356.731629:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789475584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127356.731635:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1789127356.731696:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587e5f0c0 x1876035789475584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127356.731709:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789475584:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789127357.367806:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127358.392752:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789127358.394782:0:12002:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 07:49:16 (1789127356) === 00000100:00100000:2.0:1789127358.749068:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127358.749158:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771574784 00000100:00100000:1.0:1789127358.749169:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771574784 00000100:00100000:1.0:1789127358.749249:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 291 00000100:00100000:1.0:1789127358.749260:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:8727:x1876035771574784:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789127358.749276:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127358.749292:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501a200/0xd718aadfd785d646 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffb07 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127358.749318:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501a200/0xd718aadfd785d646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb07 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127358.749330:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501a200/0xd718aadfd785d646 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb07 expref: 11 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127358.749339:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501a200, rc 0) 00000100:00100000:1.0:1789127358.749399:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:8727:x1876035771574784:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 140us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127358.749421:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 291 00000100:00100000:3.0:1789127358.754505:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127358.754672:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771574912 00000100:00100000:1.0:1789127358.754681:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771574912 00000100:00100000:1.0:1789127358.754746:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 292 00000100:00100000:1.0:1789127358.754756:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:8727:x1876035771574912:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789127358.755025:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:8727:x1876035771574912:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 270us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127358.755034:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 292 00000100:00100000:2.0:1789127358.760611:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127358.760755:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771575040 00000100:00100000:1.0:1789127358.760765:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771575040 00000100:00100000:1.0:1789127358.760815:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 293 00000100:00100000:1.0:1789127358.760825:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:8727:x1876035771575040:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789127358.760954:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:8727:x1876035771575040:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 130us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127358.760962:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 293 00000100:00100000:2.0:1789127358.771092:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127358.771173:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771575168 00000100:00100000:1.0:1789127358.771182:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771575168 00000100:00100000:1.0:1789127358.771234:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 294 00000100:00100000:1.0:1789127358.771244:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:8731:x1876035771575168:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127358.771392:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:8731:x1876035771575168:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 149us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127358.771399:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 294 00000100:00100000:0.0:1789127358.791937:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127358.792013:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771575296 00000100:00100000:3.0:1789127358.792023:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771575296 00000100:00100000:3.0:1789127358.792072:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 295 00000100:00100000:3.0:1789127358.792080:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:8731:x1876035771575296:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789127358.792217:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:8731:x1876035771575296:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 137us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127358.792225:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 295 00000100:00100000:2.0:1789127358.802326:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127358.802671:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771575424 00000100:00100000:3.0:1789127358.802691:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771575424 00000100:00100000:3.0:1789127358.802857:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 296 00000100:00100000:3.0:1789127358.802867:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:8731:x1876035771575424:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789127358.803002:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:8731:x1876035771575424:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 136us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127358.803010:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 296 00000100:00100000:2.0:1789127358.806071:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127358.806186:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771575552 00000100:00100000:1.0:1789127358.806195:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771575552 00000100:00100000:1.0:1789127358.806304:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 297 00000100:00100000:1.0:1789127358.806314:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:8727:x1876035771575552:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789127358.806331:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127358.806346:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501a600/0xd718aadfd785d64d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffb38 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127358.806373:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501a600/0xd718aadfd785d64d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb38 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127358.806384:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501a600/0xd718aadfd785d64d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb38 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127358.806393:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501a600, rc 0) 00000100:00100000:1.0:1789127358.808658:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:8727:x1876035771575552:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 2336us (2588us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127358.808669:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 297 00000100:00100000:1.0:1789127358.811133:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127358.811284:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771575680 00000100:00100000:3.0:1789127358.811293:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771575680 00000100:00100000:3.0:1789127358.811392:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 298 00000100:00100000:3.0:1789127358.811402:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:8727:x1876035771575680:12345-192.168.206.48@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789127358.811426:0:6516:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789127358.811450:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789127358.811453:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789127358.811456:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789127358.811458:0:6516:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1789127358.811460:0:6516:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789127358.813755:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:8727:x1876035771575680:12345-192.168.206.48@tcp:256:mount.lustre.0 Request processed in 2344us (2620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127358.813767:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 298 00000100:00100000:2.0:1789127358.816903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127358.816990:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771575808 00000100:00100000:1.0:1789127358.816998:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771575808 00000100:00100000:1.0:1789127358.817044:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 299 00000100:00100000:1.0:1789127358.817053:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:8727:x1876035771575808:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789127358.817066:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127358.817081:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501b800/0xd718aadfd785d654 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffb3f expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127358.817120:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501b800/0xd718aadfd785d654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb3f expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127358.817129:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501b800/0xd718aadfd785d654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb3f expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127358.817138:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b800, rc 0) 00000100:00100000:1.0:1789127358.817186:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:8727:x1876035771575808:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 135us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127358.817192:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 299 00000100:00100000:0.0:1789127358.819063:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127358.819252:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771575936 00000100:00100000:1.0:1789127358.819260:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771575936 00000100:00100000:1.0:1789127358.819309:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 300 00000100:00100000:1.0:1789127358.819316:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:8727:x1876035771575936:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789127358.819453:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:8727:x1876035771575936:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 136us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127358.819461:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 300 00000100:00100000:2.0:1789127358.821599:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127358.821745:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771576064 00000100:00100000:0.0:1789127358.821753:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771576064 00000100:00100000:0.0:1789127358.821798:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 301 00000100:00100000:0.0:1789127358.821806:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:8727:x1876035771576064:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789127358.821924:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:8727:x1876035771576064:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 118us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127358.821932:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 301 00000100:00100000:2.0:1789127358.824596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127358.824672:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771576192 00000100:00100000:3.0:1789127358.824681:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771576192 00000100:00100000:3.0:1789127358.824732:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 302 00000100:00100000:3.0:1789127358.824740:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:8737:x1876035771576192:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789127358.824866:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:8737:x1876035771576192:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 125us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127358.824873:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 302 00000100:00100000:2.0:1789127358.832124:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127358.832214:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771576320 00000100:00100000:1.0:1789127358.832225:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771576320 00000100:00100000:1.0:1789127358.832279:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 303 00000100:00100000:1.0:1789127358.832289:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:8737:x1876035771576320:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127358.832452:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:8737:x1876035771576320:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 164us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127358.832461:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 303 00000100:00100000:2.0:1789127358.841059:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127358.841095:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127358.841142:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127358.841180:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771576448 00000100:00100000:0.0:1789127358.841189:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771576448 00000100:00100000:3.0:1789127358.841227:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771576832 00000100:00100000:0.0:1789127358.841228:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771576960 00000100:00100000:3.0:1789127358.841231:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771576832 00000100:00100000:0.0:1789127358.841231:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771576960 00000100:00100000:1.0:1789127358.841293:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:1.0:1789127358.841313:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1876035771576448:12345-192.168.206.48@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789127358.841338:0:6522:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 62f6ff54-d308-4b3f-88aa-10f2416ee4e9@192.168.206.48@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:1.0:1789127358.841367:0:6522:0:(genops.c:1385:class_connect()) connect: client 62f6ff54-d308-4b3f-88aa-10f2416ee4e9, cookie 0xd718aadfd785d65b 00000100:00100000:0.0:1789127358.841458:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 130 00000100:00100000:0.0:1789127358.841464:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771576960:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127358.841561:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771576960:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 97us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127358.841567:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 130 00000004:00100000:1.0:1789127358.841625:0:6522:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789127358.841732:0:6522:0:(import.c:65:import_set_state_nolock()) ffff934587f79800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127358.841759:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2398:x1876035771576448:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 446us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127358.841765:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00080000:0.0:1789127358.844365:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127358.844384:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127358.846444:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127358.846690:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771576704 00000100:00100000:3.0:1789127358.846699:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771576704 00000100:00100000:3.0:1789127358.846771:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:3.0:1789127358.846780:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2398:x1876035771576704:12345-192.168.206.48@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789127358.846811:0:9447:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 62f6ff54-d308-4b3f-88aa-10f2416ee4e9@192.168.206.48@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:3.0:1789127358.846844:0:9447:0:(genops.c:1385:class_connect()) connect: client 62f6ff54-d308-4b3f-88aa-10f2416ee4e9, cookie 0xd718aadfd785d662 00000004:00100000:3.0:1789127358.846866:0:9447:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789127358.846963:0:9447:0:(import.c:65:import_set_state_nolock()) ffff934587f76800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127358.847020:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2398:x1876035771576704:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 240us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127358.847028:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:0.0:1789127358.847562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127358.847683:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127358.847911:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771577216 00000100:00100000:1.0:1789127358.847918:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771577216 00000100:00100000:1.0:1789127358.847963:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771576576 00000100:00100000:1.0:1789127358.847966:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771576576 00000100:00100000:1.0:1789127358.847981:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1789127358.847989:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+7:8727:x1876035771577216:12345-192.168.206.48@tcp:41:mount.lustre.0 00000100:00100000:3.0:1789127358.848013:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000004:00000024:1.0:1789127358.848015:0:9447:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789127358.848020:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+7:0:x1876035771576576:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789127358.848032:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00080000:0.0:1789127358.848107:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127358.848321:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+7:0:x1876035771576576:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 301us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127358.848329:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:2.0:1789127358.849945:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:2.0:1789127358.849959:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771576832:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127358.850020:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:8727:x1876035771577216:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 2029us (2457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127358.850028:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1789127358.851488:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127358.851543:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771577088 00000100:00100000:3.0:1789127358.851552:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771577088 00000100:00100000:3.0:1789127358.851616:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:3.0:1789127358.851626:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:0:x1876035771577088:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789127358.851656:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789127358.851734:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e86580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:0:x1876035771577088:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 110us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127358.851742:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00080000:1.0:1789127358.851865:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127358.853831:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771576832:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 3867us (12726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127358.853845:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:1.0:1789127358.854985:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127358.855061:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771577344 00000100:00100000:2.0:1789127358.855069:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771577344 00000100:00100000:2.0:1789127358.855150:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:2.0:1789127358.855159:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:8727:x1876035771577344:12345-192.168.206.48@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789127358.855223:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:8727:x1876035771577344:12345-192.168.206.48@tcp:40:mount.lustre.0 Request processed in 66us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127358.855230:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1789127358.857311:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127358.858011:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127358.858053:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127358.858082:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771577472 00000100:00100000:0.0:1789127358.858091:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771577472 00000100:00100000:0.0:1789127358.858122:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771577600 00000100:00100000:0.0:1789127358.858125:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771577600 00000100:00100000:0.0:1789127358.858139:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:0.0:1789127358.858146:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1876035771577472:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789127358.858187:0:10363:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 62f6ff54-d308-4b3f-88aa-10f2416ee4e9@192.168.206.48@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:0.0:1789127358.858219:0:10363:0:(genops.c:1385:class_connect()) connect: client 62f6ff54-d308-4b3f-88aa-10f2416ee4e9, cookie 0xd718aadfd785d669 00002000:00100000:0.0:1789127358.858232:0:10363:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 62f6ff54-d308-4b3f-88aa-10f2416ee4e9/ffff934587fd6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789127358.858248:0:10363:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789127358.858314:0:10363:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789127358.858343:0:10363:0:(import.c:65:import_set_state_nolock()) ffff934587fd1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127358.858401:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2398:x1876035771577472:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 254us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127358.858408:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:0.0:1789127358.858423:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1789127358.858427:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1876035771577600:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789127358.858443:0:10363:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 62f6ff54-d308-4b3f-88aa-10f2416ee4e9@192.168.206.48@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:0.0:1789127358.858457:0:10363:0:(genops.c:1385:class_connect()) connect: client 62f6ff54-d308-4b3f-88aa-10f2416ee4e9, cookie 0xd718aadfd785d670 00002000:00100000:0.0:1789127358.858462:0:10363:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 62f6ff54-d308-4b3f-88aa-10f2416ee4e9/ffff934587fd7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789127358.858472:0:10363:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789127358.858653:0:10363:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789127358.858667:0:10363:0:(import.c:65:import_set_state_nolock()) ffff934587fd6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127358.858689:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2398:x1876035771577600:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 260us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127358.858694:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:1.0:1789127358.859303:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771577728 00000100:00100000:1.0:1789127358.859310:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771577728 00000100:00100000:1.0:1789127358.859351:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1789127358.859357:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:8727:x1876035771577728:12345-192.168.206.48@tcp:900:mount.lustre.0 00000100:00100000:1.0:1789127358.859406:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:8727:x1876035771577728:12345-192.168.206.48@tcp:900:mount.lustre.0 Request processed in 49us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127358.859422:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:0.0:1789127358.862071:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127358.862164:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771577856 00000100:00100000:1.0:1789127358.862173:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771577856 00000100:00100000:1.0:1789127358.862257:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:1.0:1789127358.862267:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:8727:x1876035771577856:12345-192.168.206.48@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789127358.862348:0:6525:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789127358.862492:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:8727:x1876035771577856:12345-192.168.206.48@tcp:33:mount.lustre.0 Request processed in 212us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127358.862500:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00010000:00010000:0.0:1789127359.421855:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127360.444710:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127360.824947:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789475712:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127360.825073:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127360.829891:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789475712 00000100:00100000:2.0:1789127360.829905:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789475712 00000100:00100000:2.0:1789127360.829966:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789127360.829976:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789475712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127360.830010:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789127360.830085:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789475712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (5012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127360.830100:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789127360.830145:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789475712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127361.336674:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789475840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127361.336754:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127361.336820:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789475968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127361.336846:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127361.336876:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789475840 00000100:00100000:1.0:1789127361.336882:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789475840 00000100:00100000:1.0:1789127361.336929:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789127361.336939:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789475840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789127361.336966:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127361.337008:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789475840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.337015:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789127361.337035:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789475968 00000100:00100000:1.0:1789127361.337038:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789475968 00000100:00100000:1.0:1789127361.337106:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789127361.337112:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789475968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127361.337142:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789127361.337179:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789475968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.337185:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1789127361.337201:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789127361.337229:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e87480 x1876035789475840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127361.337246:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789475840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127361.337281:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789475968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127361.337898:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127361.337909:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789476096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127361.337941:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127361.337979:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789476096 00000100:00100000:1.0:1789127361.337984:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789476096 00000100:00100000:1.0:1789127361.338020:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789127361.338028:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789476096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789127361.338041:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127361.338072:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789476096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.338078:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1789127361.338094:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789127361.338113:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e84f00 x1876035789476096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127361.338126:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789476096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127361.339475:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789476352:0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.339553:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127361.339581:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789476864:0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.339606:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127361.339629:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789127361.339635:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789476224:0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.339663:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127361.339685:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789476736:0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.339721:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127361.339740:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789477248:0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.339760:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127361.339787:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789476352 00000100:00100000:1.0:1789127361.339793:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789476352 00000100:00100000:1.0:1789127361.339831:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789476736 00000100:00100000:1.0:1789127361.339834:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789476736 00000100:00100000:1.0:1789127361.339853:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789477248 00000100:00100000:1.0:1789127361.339856:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789477248 00000100:00100000:1.0:1789127361.339870:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789127361.339877:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789476352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.339922:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789476352:12345-0@lo:400:kworker.0 Request processed in 45us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.339929:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789127361.339944:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789127361.339950:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789476736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.339977:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789476736:12345-0@lo:400:kworker.0 Request processed in 28us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.339983:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789127361.340002:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789127361.340008:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789477248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.340037:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789477248:12345-0@lo:400:kworker.0 Request processed in 29us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.340042:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789127361.340063:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789476864 00000100:00100000:1.0:1789127361.340067:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789476864 00000100:00100000:1.0:1789127361.340094:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789127361.340100:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789476864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.340128:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789476864:12345-0@lo:400:kworker.0 Request processed in 28us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.340133:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789127361.340151:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789476224 00000100:00100000:1.0:1789127361.340154:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789476224 00000100:00100000:1.0:1789127361.340224:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789127361.340232:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789476224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.340259:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789476224:12345-0@lo:400:kworker.0 Request processed in 29us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.340265:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:1.0:1789127361.340302:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789127361.340307:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127361.340318:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692956d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789476480:0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.340342:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127361.340359:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789476992:0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.340380:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127361.340400:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789127361.340406:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692956580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789476608:0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.340436:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127361.340453:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789477120:0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.340471:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127361.340493:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789476992 00000100:00100000:1.0:1789127361.340497:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789476992 00000100:00100000:1.0:1789127361.340557:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789127361.340564:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789476992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.340597:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789476992:12345-0@lo:400:kworker.0 Request processed in 34us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.340603:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789127361.340621:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789476480 00000100:00100000:1.0:1789127361.340624:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789476480 00000100:00100000:1.0:1789127361.340642:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789476608 00000100:00100000:1.0:1789127361.340645:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789476608 00000100:00100000:1.0:1789127361.340656:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789477120 00000100:00100000:1.0:1789127361.340658:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789477120 00000100:00100000:1.0:1789127361.340669:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789127361.340675:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789476480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.340719:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789476480:12345-0@lo:400:kworker.0 Request processed in 44us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.340725:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789127361.340736:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789127361.340742:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789476608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.340767:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789476608:12345-0@lo:400:kworker.0 Request processed in 26us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.340773:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789127361.340783:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789127361.340797:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789477120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.340826:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789477120:12345-0@lo:400:kworker.0 Request processed in 31us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127361.340832:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:1.0:1789127361.340847:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127361.340851:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127361.340891:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692956580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789476608:0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.340901:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789477120:0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.340909:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692956d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789476480:0@lo:400:kworker.0 00010000:00080000:1.0:1789127361.340919:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aed11a40 x1876035789476992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127361.340928:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789476992:0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.340968:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e84f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789476224:0@lo:400:kworker.0 00010000:00080000:1.0:1789127361.340979:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7392580 x1876035789476736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127361.340987:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7392580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789476736:0@lo:400:kworker.0 00010000:00080000:1.0:1789127361.340997:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73a1a40 x1876035789477248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127361.341004:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789477248:0@lo:400:kworker.0 00000100:00100000:1.0:1789127361.341013:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789476352:0@lo:400:kworker.0 00010000:00080000:1.0:1789127361.341022:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aed13c00 x1876035789476864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127361.341041:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed13c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789476864:0@lo:400:kworker.0 00010000:00010000:2.0:1789127361.466651:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127361.851395:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127361.851416:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789477376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127361.851492:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127361.851572:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789477376 00000100:00100000:3.0:1789127361.851579:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789477376 00000100:00100000:3.0:1789127361.851624:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789127361.851633:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789477376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127361.851659:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127361.851714:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789477376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127361.851722:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:3.0:1789127361.851757:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b0a940 x1876035789477376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127361.851772:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789477376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127361.852292:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127361.852302:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789477504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127361.852330:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127361.852359:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789477504 00000100:00100000:3.0:1789127361.852363:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789477504 00000100:00100000:3.0:1789127361.852389:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789127361.852396:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789477504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127361.852407:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127361.852438:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789477504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 43us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127361.852445:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1789127361.852470:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b0a940 x1876035789477504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127361.852483:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789477504:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789127362.487676:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127363.511761:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127364.091895:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127364.092238:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771577984 00000100:00100000:3.0:1789127364.092252:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771577984 00000100:00100000:3.0:1789127364.092479:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 305 00000100:00100000:3.0:1789127364.092500:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771577984:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127364.092693:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771577984:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 201us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127364.092712:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 305 00000100:00100000:1.0:1789127364.109067:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127364.109199:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127364.109222:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771578112 00000100:00100000:1.0:1789127364.109230:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771578112 00000100:00100000:1.0:1789127364.109283:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771578368 00000100:00100000:1.0:1789127364.109286:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771578368 00000100:00100000:1.0:1789127364.109306:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 138 00000100:00100000:1.0:1789127364.109317:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771578112:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127364.109387:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771578112:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 72us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127364.109395:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 138 00000100:00100000:1.0:1789127364.109411:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 139 00000100:00100000:1.0:1789127364.109417:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2402:x1876035771578368:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127364.109442:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2402:x1876035771578368:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 24us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127364.109448:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 139 00000100:00080000:1.0:1789127364.109464:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127364.109498:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127364.109578:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127364.109647:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127364.109668:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127364.109698:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771578624 00000100:00100000:1.0:1789127364.109702:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771578624 00000100:00100000:1.0:1789127364.109730:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771578752 00000100:00100000:1.0:1789127364.109739:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771578752 00000100:00100000:1.0:1789127364.109762:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:1.0:1789127364.109768:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7392580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2402:x1876035771578624:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127364.109796:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7392580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2402:x1876035771578624:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 29us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127364.109803:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:1.0:1789127364.109814:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:1.0:1789127364.109819:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2402:x1876035771578752:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127364.109839:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2402:x1876035771578752:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 21us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127364.109845:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:1.0:1789127364.109858:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771578240 00000100:00100000:1.0:1789127364.109861:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771578240 00000100:00100000:1.0:1789127364.109881:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771578496 00000100:00100000:1.0:1789127364.109884:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771578496 00000100:00100000:1.0:1789127364.109898:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 140 00000100:00100000:1.0:1789127364.109904:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771578240:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127364.109929:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e84f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771578240:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 24us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127364.109935:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 140 00000100:00100000:1.0:1789127364.109946:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 141 00000100:00100000:1.0:1789127364.109951:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2402:x1876035771578496:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127364.109972:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2402:x1876035771578496:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 21us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127364.109978:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 141 00000100:00080000:1.0:1789127364.110003:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127364.110007:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127364.110008:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789127364.537208:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789127364.794919:0:12195:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:1.0:1789127364.925787:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 62f6ff54-d308-4b3f-88aa-10f2416ee4e9 00000001:00100000:0.0:1789127364.927658:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 62f6ff54-d308-4b3f-88aa-10f2416ee4e9 00000001:00100000:0.0:1789127364.927968:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 62f6ff54-d308-4b3f-88aa-10f2416ee4e9 00000001:00100000:1.0:1789127364.929203:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 62f6ff54-d308-4b3f-88aa-10f2416ee4e9 00010000:00010000:0.0:1789127365.560036:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127365.943875:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127365.943898:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789477632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127365.943967:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127365.944024:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789477632 00000100:00100000:2.0:1789127365.944032:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789477632 00000100:00100000:2.0:1789127365.944079:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789127365.944089:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789477632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127365.944121:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789127365.944174:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789477632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127365.944182:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789127365.944433:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789477632:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127366.471039:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789477888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127366.471106:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127366.471160:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127366.471166:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789477760:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127366.471192:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127366.471224:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789477760 00000100:00100000:1.0:1789127366.471231:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789477760 00000100:00100000:1.0:1789127366.471278:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789127366.471288:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692956580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789477760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127366.471319:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789127366.471412:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692956580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789477760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127366.471419:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789127366.471462:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789477760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127366.471703:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789477888 00000100:00100000:3.0:1789127366.471708:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789477888 00000100:00100000:3.0:1789127366.471745:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789127366.471753:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692956d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789477888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127366.471771:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127366.471806:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692956d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789477888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127366.471811:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789127366.471830:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789478016:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127366.471855:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789127366.471892:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127366.471903:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789478016 00000100:00100000:3.0:1789127366.471906:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789478016 00000100:00100000:3.0:1789127366.471932:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789127366.471938:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789478016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789127366.471947:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127366.471977:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789478016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127366.471983:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1789127366.472015:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789127366.472038:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b0a940 x1876035789478016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127366.472052:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789478016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127366.472282:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789478272:0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.472314:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127366.472347:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789478784:0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.472371:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127366.472391:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789127366.472397:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789478400:0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.472419:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127366.472436:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789478912:0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.472456:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127366.472494:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789478272 00000100:00100000:2.0:1789127366.472498:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789478272 00000100:00100000:2.0:1789127366.472545:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789478400 00000100:00100000:2.0:1789127366.472548:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789478400 00000100:00100000:2.0:1789127366.472567:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789127366.472582:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789478272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.472620:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789478272:12345-0@lo:400:kworker.0 Request processed in 39us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.472626:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789127366.472640:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789127366.472646:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789478400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.472691:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789478400:12345-0@lo:400:kworker.0 Request processed in 46us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.472696:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789127366.472713:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789478784 00000100:00100000:2.0:1789127366.472717:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789478784 00000100:00100000:2.0:1789127366.472744:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789478912 00000100:00100000:2.0:1789127366.472747:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789478912 00000100:00100000:2.0:1789127366.472765:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789127366.472770:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789478784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.472800:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789478784:12345-0@lo:400:kworker.0 Request processed in 29us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.472805:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789127366.472816:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789127366.472822:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7395680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789478912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.472848:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7395680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789478912:12345-0@lo:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.472852:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789127366.472882:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127366.472892:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789478528:0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.472916:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127366.472941:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789479040:0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.472964:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127366.472980:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789127366.472986:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789478144:0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.473010:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127366.473031:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789478656:0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.473052:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127366.473065:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789479168:0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.473083:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127366.473103:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789478144 00000100:00100000:2.0:1789127366.473107:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789478144 00000100:00100000:2.0:1789127366.473132:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789127366.473137:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789478144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.473168:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789478144:12345-0@lo:400:kworker.0 Request processed in 31us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.473173:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789127366.473199:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789478528 00000100:00100000:2.0:1789127366.473202:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789478528 00000100:00100000:2.0:1789127366.473224:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789479040 00000100:00100000:2.0:1789127366.473227:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789479040 00000100:00100000:2.0:1789127366.473236:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789478656 00000100:00100000:2.0:1789127366.473238:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789478656 00000100:00100000:2.0:1789127366.473247:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789479168 00000100:00100000:2.0:1789127366.473248:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789479168 00000100:00100000:2.0:1789127366.473261:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789127366.473266:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7397c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789478528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.473294:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7397c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789478528:12345-0@lo:400:kworker.0 Request processed in 27us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.473304:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789127366.473317:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789127366.473321:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789479040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.473347:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789479040:12345-0@lo:400:kworker.0 Request processed in 26us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.473352:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789127366.473362:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789127366.473367:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7396580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789478656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.473392:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7396580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789478656:12345-0@lo:400:kworker.0 Request processed in 26us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.473398:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789127366.473409:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789127366.473415:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7395e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789479168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.473438:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7395e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789479168:12345-0@lo:400:kworker.0 Request processed in 25us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127366.473443:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:2.0:1789127366.473460:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127366.473463:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127366.473486:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789478400:0@lo:400:kworker.0 00010000:00080000:2.0:1789127366.473498:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93458840ed00 x1876035789478912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127366.473529:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789478912:0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.473541:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789478272:0@lo:400:kworker.0 00010000:00080000:2.0:1789127366.473550:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93458840e580 x1876035789478784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127366.473565:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789478784:0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.473598:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789478144:0@lo:400:kworker.0 00010000:00080000:2.0:1789127366.473607:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93458840f0c0 x1876035789478656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127366.473615:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789478656:0@lo:400:kworker.0 00010000:00080000:2.0:1789127366.473624:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878cf480 x1876035789479168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127366.473631:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789479168:0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.473640:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789478528:0@lo:400:kworker.0 00000100:00100000:2.0:1789127366.473649:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789479040:0@lo:400:kworker.0 00010000:00080000:1.0:1789127366.475974:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73a2580 x1876035789477888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127366.476004:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789477888:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789127366.583902:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127366.969873:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127366.969898:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789479296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127366.969962:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127366.970178:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789479296 00000100:00100000:3.0:1789127366.970185:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789479296 00000100:00100000:3.0:1789127366.970230:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789127366.970239:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789479296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127366.970269:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127366.970319:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789479296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127366.970326:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789127366.970373:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127366.970384:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789479424:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127366.970419:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127366.970592:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789479424 00000100:00100000:3.0:1789127366.970597:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789479424 00000100:00100000:3.0:1789127366.970614:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789127366.970620:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789479424:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127366.970630:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127366.970784:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789479424:12345-0@lo:13:osp-pre-0-1.0 Request processed in 163us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127366.970791:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1789127366.973484:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73a2580 x1876035789479296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127366.973544:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789479296:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789127366.974578:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b0a940 x1876035789479424/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127366.974687:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789479424:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789127367.611841:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127368.632641:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127369.215882:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127369.215922:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127369.215956:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127369.215981:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127369.216001:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127369.216021:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127369.216046:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127369.216073:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771579136 00000100:00100000:1.0:1789127369.216082:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771579136 00000100:00100000:1.0:1789127369.216134:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771579392 00000100:00100000:1.0:1789127369.216138:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771579392 00000100:00100000:1.0:1789127369.216151:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771579008 00000100:00100000:1.0:1789127369.216153:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771579008 00000100:00100000:1.0:1789127369.216164:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771579264 00000100:00100000:1.0:1789127369.216167:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771579264 00000100:00100000:1.0:1789127369.216181:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 148 00000100:00100000:1.0:1789127369.216191:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771579136:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127369.216262:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771579136:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 71us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127369.216270:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 148 00000100:00100000:1.0:1789127369.216286:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 149 00000100:00100000:1.0:1789127369.216293:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771579392:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127369.216316:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771579392:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 23us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127369.216334:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 149 00000100:00100000:1.0:1789127369.216348:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 150 00000100:00100000:1.0:1789127369.216354:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7decf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2399:x1876035771579008:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127369.216384:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7decf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2399:x1876035771579008:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 31us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127369.216389:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 150 00000100:00100000:1.0:1789127369.216399:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 151 00000100:00100000:1.0:1789127369.216405:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771579264:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127369.216422:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771579264:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 19us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127369.216427:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 151 00000100:00100000:1.0:1789127369.216443:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771579648 00000100:00100000:1.0:1789127369.216446:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771579648 00000100:00100000:1.0:1789127369.216472:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771579520 00000100:00100000:1.0:1789127369.216475:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771579520 00000100:00100000:1.0:1789127369.216494:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:1.0:1789127369.216500:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771579648:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127369.216549:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771579648:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 49us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127369.216555:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:1.0:1789127369.216566:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:1.0:1789127369.216572:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771579520:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127369.216593:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771579520:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 21us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127369.216605:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00080000:1.0:1789127369.216631:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789127369.216635:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127369.216638:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127369.216640:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127369.218042:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771578880 00000100:00100000:3.0:1789127369.218054:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771578880 00000100:00100000:3.0:1789127369.218113:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 307 00000100:00100000:3.0:1789127369.218122:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771578880:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127369.218175:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771578880:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 55us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127369.218195:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 307 00010000:00010000:0.0:1789127369.655672:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127370.681010:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127371.064220:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127371.065553:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789479552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127371.065628:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127371.071760:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789479552 00000100:00100000:2.0:1789127371.071773:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789479552 00000100:00100000:2.0:1789127371.071837:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789127371.071847:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789479552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127371.071898:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789127371.073112:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789479552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1260us (7477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127371.073123:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789127371.073205:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789479552:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127371.576302:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789479808:0@lo:400:kworker.0 00000100:00100000:3.0:1789127371.576375:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127371.576836:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789479680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127371.576873:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127371.576922:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789480192:0@lo:400:kworker.0 00000100:00100000:1.0:1789127371.576948:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127371.576966:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789480704:0@lo:400:kworker.0 00000100:00100000:1.0:1789127371.576989:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127371.577006:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789481216:0@lo:400:kworker.0 00000100:00100000:1.0:1789127371.577024:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127371.577045:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789127371.577051:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789480064:0@lo:400:kworker.0 00000100:00100000:1.0:1789127371.577072:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127371.577092:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789480576:0@lo:400:kworker.0 00000100:00100000:1.0:1789127371.577111:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127371.577125:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789481088:0@lo:400:kworker.0 00000100:00100000:1.0:1789127371.577143:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127371.577172:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789479936:0@lo:400:kworker.0 00000100:00100000:1.0:1789127371.577193:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127371.577208:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789480448:0@lo:400:kworker.0 00000100:00100000:1.0:1789127371.577238:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127371.577252:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789480960:0@lo:400:kworker.0 00000100:00100000:1.0:1789127371.577279:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127371.577298:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127371.577303:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789481344:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127371.577322:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127371.577686:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789480192 00000100:00100000:0.0:1789127371.577693:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789480192 00000100:00100000:0.0:1789127371.577733:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789127371.577742:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587838780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789480192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127371.577808:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587838780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789480192:12345-0@lo:400:kworker.0 Request processed in 56us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127371.577816:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789127371.577882:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789480704 00000100:00100000:0.0:1789127371.577886:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789480704 00000100:00100000:0.0:1789127371.577913:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789481216 00000100:00100000:0.0:1789127371.577916:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789481216 00000100:00100000:0.0:1789127371.577929:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789480576 00000100:00100000:0.0:1789127371.577931:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789480576 00000100:00100000:0.0:1789127371.577953:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789481088 00000100:00100000:0.0:1789127371.577956:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789481088 00000100:00100000:0.0:1789127371.577969:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789127371.577975:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789480704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127371.578006:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789480704:12345-0@lo:400:kworker.0 Request processed in 31us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127371.578013:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789127371.578024:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789127371.578029:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789481216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127371.578054:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878392c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789481216:12345-0@lo:400:kworker.0 Request processed in 25us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127371.578060:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789127371.578070:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789127371.578076:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789480576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127371.578098:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789480576:12345-0@lo:400:kworker.0 Request processed in 23us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127371.578104:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789127371.578113:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789127371.578118:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789481088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127371.578141:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789481088:12345-0@lo:400:kworker.0 Request processed in 22us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127371.578146:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789127371.578164:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789480064 00000100:00100000:0.0:1789127371.578168:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789480064 00000100:00100000:0.0:1789127371.578182:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789479936 00000100:00100000:0.0:1789127371.578184:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789479936 00000100:00100000:0.0:1789127371.578210:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789480448 00000100:00100000:0.0:1789127371.578218:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789480448 00000100:00100000:0.0:1789127371.578231:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789480960 00000100:00100000:0.0:1789127371.578233:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789480960 00000100:00100000:0.0:1789127371.578245:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789127371.578250:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789480064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127371.578279:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789480064:12345-0@lo:400:kworker.0 Request processed in 29us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127371.578285:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789127371.578295:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789127371.578300:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789479936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127371.578324:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789479936:12345-0@lo:400:kworker.0 Request processed in 24us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127371.578330:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789127371.578341:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789127371.578347:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789480448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127371.578373:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789480448:12345-0@lo:400:kworker.0 Request processed in 26us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127371.578379:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789127371.579302:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789480320:0@lo:400:kworker.0 00000100:00100000:3.0:1789127371.579341:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127371.579353:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789480832:0@lo:400:kworker.0 00000100:00100000:3.0:1789127371.579373:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127371.579402:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127371.579409:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789481472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127371.579434:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127371.579468:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789479808 00000100:00100000:3.0:1789127371.579474:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789479808 00000100:00100000:3.0:1789127371.579528:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789127371.579537:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789479808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127371.579575:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789479808:12345-0@lo:400:kworker.0 Request processed in 39us (3200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127371.579582:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789127371.580219:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789479808:0@lo:400:kworker.0 00000100:00100000:3.0:1789127371.580428:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789481472 00000100:00100000:3.0:1789127371.580433:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789481472 00000100:00100000:3.0:1789127371.580463:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789127371.580470:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789481472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127371.580497:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789127371.580578:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789481472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127371.580597:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789127371.580645:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789481472:0@lo:41:osp-pre-1-0.0 00000100:00080000:3.0:1789127371.580714:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789127371.580719:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127371.580722:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127371.580731:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789480320 00000100:00100000:3.0:1789127371.580735:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789480320 00000100:00100000:3.0:1789127371.580760:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789480832 00000100:00100000:3.0:1789127371.580763:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789480832 00000100:00100000:3.0:1789127371.580777:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789127371.580783:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789480960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127371.580815:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789480960:12345-0@lo:400:kworker.0 Request processed in 32us (3536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127371.580821:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789127371.580834:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789127371.580840:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789480320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127371.580873:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789480320:12345-0@lo:400:kworker.0 Request processed in 33us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127371.580879:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789127371.580889:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789127371.580897:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789480832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127371.580921:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789480832:12345-0@lo:400:kworker.0 Request processed in 26us (1548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127371.580927:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1789127371.580998:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127371.581018:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789480320:0@lo:400:kworker.0 00000100:00100000:3.0:1789127371.581038:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789480832:0@lo:400:kworker.0 00000100:00100000:3.0:1789127371.581066:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789480064:0@lo:400:kworker.0 00010000:00080000:3.0:1789127371.581080:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b092c0 x1876035789480576/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127371.581089:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789480576:0@lo:400:kworker.0 00010000:00080000:3.0:1789127371.581100:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587f083c0 x1876035789481088/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127371.581108:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789481088:0@lo:400:kworker.0 00000100:00100000:3.0:1789127371.581118:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789480192:0@lo:400:kworker.0 00010000:00080000:3.0:1789127371.581128:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b0a580 x1876035789480704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127371.581135:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789480704:0@lo:400:kworker.0 00010000:00080000:3.0:1789127371.581145:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587f09680 x1876035789481216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127371.581152:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789481216:0@lo:400:kworker.0 00000100:00100000:1.0:1789127371.582463:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789479936:0@lo:400:kworker.0 00010000:00080000:1.0:1789127371.582480:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b0a940 x1876035789480448/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127371.582489:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789480448:0@lo:400:kworker.0 00010000:00080000:1.0:1789127371.582501:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587f09e00 x1876035789480960/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127371.582537:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789480960:0@lo:400:kworker.0 00000100:00100000:3.0:1789127371.589259:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789479680 00000100:00100000:3.0:1789127371.589272:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789479680 00000100:00100000:3.0:1789127371.589321:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789481344 00000100:00100000:3.0:1789127371.589324:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789481344 00000100:00100000:3.0:1789127371.589341:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789127371.589349:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587839680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789479680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127371.589376:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127371.589495:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789127371.589506:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789481344:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127371.589540:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127371.589833:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789481344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 328us (12507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127371.589842:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1789127371.590564:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878cd680 x1876035789481344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127371.590590:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789481344:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127371.591090:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587839680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789479680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1740us (14214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127371.591099:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1789127371.591326:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587eb8000 x1876035789479680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127371.591344:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789479680:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789127371.703807:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127372.087849:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789481600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127372.087921:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127372.088021:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789481600 00000100:00100000:3.0:1789127372.088029:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789481600 00000100:00100000:3.0:1789127372.088081:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789127372.088090:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789481600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127372.088117:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127372.088158:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789481600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127372.088166:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:0.0:1789127372.088335:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebde00 x1876035789481600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127372.088372:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789481600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127372.088781:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127372.088792:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789481728:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127372.088823:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127372.089401:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789481728 00000100:00100000:1.0:1789127372.089408:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789481728 00000100:00100000:1.0:1789127372.089459:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789127372.089469:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789481728:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127372.089486:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127372.089555:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789481728:12345-0@lo:13:osp-pre-0-1.0 Request processed in 87us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127372.089562:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1789127372.089660:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587f09680 x1876035789481728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127372.089676:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789481728:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1789127372.494160:0:12511:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127372.494473:0:12511:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789127372.727746:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127373.751829:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127374.331720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127374.331759:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127374.331794:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127374.331824:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127374.331844:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127374.331862:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127374.332065:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771579904 00000100:00100000:2.0:1789127374.332075:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771579904 00000100:00100000:2.0:1789127374.332137:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771580160 00000100:00100000:2.0:1789127374.332141:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771580160 00000100:00100000:2.0:1789127374.332165:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771580032 00000100:00100000:2.0:1789127374.332169:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771580032 00000100:00100000:2.0:1789127374.332180:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771580288 00000100:00100000:2.0:1789127374.332182:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771580288 00000100:00100000:2.0:1789127374.332198:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 158 00000100:00100000:2.0:1789127374.332208:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2399:x1876035771579904:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127374.332280:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2399:x1876035771579904:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 73us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127374.332288:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 158 00000100:00100000:2.0:1789127374.332313:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 159 00000100:00100000:2.0:1789127374.332319:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771580160:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127374.332346:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771580160:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 28us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127374.332351:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 159 00000100:00100000:2.0:1789127374.332362:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 160 00000100:00100000:2.0:1789127374.332368:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771580032:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127374.332390:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f08b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771580032:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 22us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127374.332396:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 160 00000100:00100000:2.0:1789127374.332407:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 161 00000100:00100000:2.0:1789127374.332413:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771580288:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127374.332432:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771580288:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 20us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127374.332437:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 161 00000100:00100000:3.0:1789127374.332833:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127374.336145:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771579776 00000100:00100000:2.0:1789127374.336158:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771579776 00000100:00100000:2.0:1789127374.336213:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 309 00000100:00100000:2.0:1789127374.336224:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771579776:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127374.336678:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771579776:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 454us (4851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127374.336687:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 309 00000100:00100000:2.0:1789127374.336735:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771580416 00000100:00100000:2.0:1789127374.336740:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771580416 00000100:00100000:2.0:1789127374.336782:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771580544 00000100:00100000:2.0:1789127374.336786:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771580544 00000100:00100000:2.0:1789127374.336809:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:2.0:1789127374.336817:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771580416:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127374.336861:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771580416:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 45us (5066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127374.336867:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:2.0:1789127374.336880:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:2.0:1789127374.336887:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771580544:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127374.336925:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771580544:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 38us (4092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127374.336931:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00080000:2.0:1789127374.336976:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127374.336980:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127374.336982:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127374.336984:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000004:1.0:1789127374.751108:0:12608:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789127374.751373:0:12608:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789127374.776087:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127375.800276:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127376.183844:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789481856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127376.183918:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127376.184119:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789481856 00000100:00100000:0.0:1789127376.184128:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789481856 00000100:00100000:0.0:1789127376.184191:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789127376.184202:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690657050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789481856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127376.184237:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789127376.184297:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690657050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789481856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127376.184304:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789127376.184349:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789481856:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127376.696086:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789481984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127376.696160:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127376.696278:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789481984 00000100:00100000:2.0:1789127376.696286:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789481984 00000100:00100000:2.0:1789127376.696343:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789127376.696353:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346bfa86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789481984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127376.696382:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127376.696443:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346bfa86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789481984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127376.696450:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789127376.696693:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127376.696703:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789482112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127376.696730:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789127376.697059:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127376.697072:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789482112 00000100:00100000:1.0:1789127376.697077:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789482112 00000100:00100000:1.0:1789127376.697124:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789127376.697132:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789482112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789127376.697146:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127376.697183:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789482112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127376.697189:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1789127376.697221:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878cc3c0 x1876035789482112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127376.697237:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789482112:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789127376.697265:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878cd680 x1876035789481984/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127376.697276:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789481984:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1789127376.699994:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127376.705038:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789482368:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.705106:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127376.705148:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789482880:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.705168:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127376.705196:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789483392:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.705215:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127376.705243:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789127376.705249:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789482496:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.705270:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127376.705291:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789483008:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.705314:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127376.705353:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789482368 00000100:00100000:1.0:1789127376.705359:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789482368 00000100:00100000:1.0:1789127376.705392:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789482880 00000100:00100000:1.0:1789127376.705394:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789482880 00000100:00100000:1.0:1789127376.705412:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789483392 00000100:00100000:1.0:1789127376.705414:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789483392 00000100:00100000:1.0:1789127376.705424:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789482496 00000100:00100000:1.0:1789127376.705426:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789482496 00000100:00100000:1.0:1789127376.705439:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789127376.705446:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789482368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.705490:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789482368:12345-0@lo:400:kworker.0 Request processed in 45us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127376.705497:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789127376.705526:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789127376.705532:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789482880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.705556:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789482880:12345-0@lo:400:kworker.0 Request processed in 24us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127376.705561:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789127376.705572:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789127376.705577:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789483392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.705624:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789483392:12345-0@lo:400:kworker.0 Request processed in 47us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127376.705630:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789127376.705642:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789127376.705647:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789482496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.705671:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789482496:12345-0@lo:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127376.705677:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:1.0:1789127376.705703:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127376.705715:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789482240:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.705744:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127376.705765:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789482752:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.705784:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127376.705795:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789483264:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.705811:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127376.705824:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789127376.705829:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789482624:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.705892:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127376.705908:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789483136:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.705926:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127376.705946:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789482240 00000100:00100000:1.0:1789127376.705950:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789482240 00000100:00100000:1.0:1789127376.705971:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789127376.705975:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789482240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.706002:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789482240:12345-0@lo:400:kworker.0 Request processed in 27us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127376.706013:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1789127376.706037:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789482624 00000100:00100000:1.0:1789127376.706040:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789482624 00000100:00100000:1.0:1789127376.706059:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789127376.706064:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789482624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.706089:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789482624:12345-0@lo:400:kworker.0 Request processed in 26us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127376.706094:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789127376.706109:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789482752 00000100:00100000:1.0:1789127376.706111:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789482752 00000100:00100000:1.0:1789127376.706129:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789483264 00000100:00100000:1.0:1789127376.706131:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789483264 00000100:00100000:1.0:1789127376.706144:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789127376.706149:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789482752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.706172:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789482752:12345-0@lo:400:kworker.0 Request processed in 23us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127376.706177:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789127376.706185:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789127376.706190:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789483264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.706208:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789483264:12345-0@lo:400:kworker.0 Request processed in 18us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127376.706213:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00080000:1.0:1789127376.706225:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127376.706251:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789482496:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.706261:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789482368:0@lo:400:kworker.0 00010000:00080000:1.0:1789127376.706283:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587f0b480 x1876035789482880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127376.706292:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789482880:0@lo:400:kworker.0 00010000:00080000:1.0:1789127376.706301:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587e5c3c0 x1876035789483392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127376.706309:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789483392:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.706341:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789482624:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.706348:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789482240:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.706355:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789482752:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.706362:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789483264:0@lo:400:kworker.0 00000100:00100000:2.0:1789127376.707079:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789483008 00000100:00100000:2.0:1789127376.707087:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789483008 00000100:00100000:2.0:1789127376.707136:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789483136 00000100:00100000:2.0:1789127376.707139:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789483136 00000100:00100000:2.0:1789127376.707159:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789127376.707166:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789483008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127376.707217:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789483008:12345-0@lo:400:kworker.0 Request processed in 51us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127376.707223:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789127376.707235:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789127376.707241:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789483136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127376.707270:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789483136:12345-0@lo:400:kworker.0 Request processed in 29us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127376.707275:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1789127376.708056:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789127376.708095:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587f09e00 x1876035789483136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127376.708107:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789483136:0@lo:400:kworker.0 00010000:00080000:1.0:1789127376.708138:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587f09680 x1876035789483008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127376.708147:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789483008:0@lo:400:kworker.0 00000100:00100000:1.0:1789127376.709039:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127376.709054:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789483520:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127376.709105:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127376.709479:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789483520 00000100:00100000:0.0:1789127376.709485:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789483520 00000100:00100000:0.0:1789127376.709782:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789127376.709793:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789483520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789127376.709824:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127376.709881:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789483520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127376.709888:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789127376.709988:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789483520:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789127376.823969:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789127376.953353:0:12706:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789127376.954469:0:12706:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789127377.208030:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789483648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127377.208100:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127377.209960:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789483776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127377.210018:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127377.210072:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789483648 00000100:00100000:1.0:1789127377.210080:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789483648 00000100:00100000:1.0:1789127377.210121:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789483776 00000100:00100000:1.0:1789127377.210124:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789483776 00000100:00100000:1.0:1789127377.210140:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789127377.210148:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789483648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127377.210174:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127377.210212:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789483648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (2112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127377.210219:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789127377.210234:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789127377.210241:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789483776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127377.210250:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127377.210278:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789483776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127377.210284:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:1.0:1789127377.210323:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebe940 x1876035789483776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127377.210341:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789483776:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789127377.210373:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587e5cf00 x1876035789483648/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127377.210386:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789483648:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789127377.847690:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127378.871814:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789127379.105869:0:12805:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127379.106260:0:12805:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789127379.452993:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127379.453031:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127379.453071:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127379.453092:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127379.453129:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127379.453154:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771580672 00000100:00100000:2.0:1789127379.453163:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771580672 00000100:00100000:2.0:1789127379.453208:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 311 00000100:00100000:2.0:1789127379.453219:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771580672:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127379.453296:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771580672:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127379.453315:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 311 00000100:00100000:2.0:1789127379.453347:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771580800 00000100:00100000:2.0:1789127379.453351:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771580800 00000100:00100000:2.0:1789127379.453381:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771581056 00000100:00100000:2.0:1789127379.453384:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771581056 00000100:00100000:2.0:1789127379.453397:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771580928 00000100:00100000:2.0:1789127379.453399:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771580928 00000100:00100000:2.0:1789127379.453410:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771581184 00000100:00100000:2.0:1789127379.453413:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771581184 00000100:00100000:2.0:1789127379.453426:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 168 00000100:00100000:2.0:1789127379.453433:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771580800:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127379.453462:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771580800:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 30us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127379.453468:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 168 00000100:00100000:2.0:1789127379.453480:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 169 00000100:00100000:2.0:1789127379.453486:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771581056:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127379.453534:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771581056:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 22us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127379.453541:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 169 00000100:00100000:2.0:1789127379.453553:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 170 00000100:00100000:2.0:1789127379.453559:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771580928:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127379.453583:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771580928:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127379.453601:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 170 00000100:00100000:2.0:1789127379.453613:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 171 00000100:00100000:2.0:1789127379.453627:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771581184:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127379.453651:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771581184:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127379.453657:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 171 00000100:00080000:2.0:1789127379.453791:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127379.453795:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127379.455186:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127379.455236:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127379.455293:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771581312 00000100:00100000:1.0:1789127379.455311:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771581312 00000100:00100000:1.0:1789127379.455380:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771581440 00000100:00100000:1.0:1789127379.455384:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771581440 00000100:00100000:1.0:1789127379.455407:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:1.0:1789127379.455417:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2398:x1876035771581312:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:1.0:1789127379.455443:0:8755:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d669 00000100:00080000:1.0:1789127379.455452:0:8755:0:(import.c:65:import_set_state_nolock()) ffff934587fd1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789127379.455494:0:8755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789127379.455650:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+2:2398:x1876035771581312:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 234us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127379.455658:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:1.0:1789127379.455673:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:1.0:1789127379.455679:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2398:x1876035771581440:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:1.0:1789127379.455689:0:8755:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d670 00000100:00080000:1.0:1789127379.455695:0:8755:0:(import.c:65:import_set_state_nolock()) ffff934587fd6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789127379.455715:0:8755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789127379.455778:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+2:2398:x1876035771581440:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 99us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127379.455785:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00010000:00010000:3.0:1789127379.455923:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127379.455937:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789127379.455945:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127379.455948:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789127379.896657:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127380.922347:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789127381.065493:0:12902:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789127381.067058:0:12902:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789127381.304248:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789483904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127381.304315:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127381.304404:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789483904 00000100:00100000:3.0:1789127381.304412:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789483904 00000100:00100000:3.0:1789127381.304462:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789127381.304471:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789483904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127381.304502:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789127381.304600:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789483904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127381.304608:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789127381.304653:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789483904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127381.815802:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789484160:0@lo:400:kworker.0 00000100:00100000:3.0:1789127381.815898:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127381.815981:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789484672:0@lo:400:kworker.0 00000100:00100000:3.0:1789127381.816006:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127381.816030:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789485184:0@lo:400:kworker.0 00000100:00100000:3.0:1789127381.816057:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127381.816061:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789484032:0@lo:400:kworker.0 00000100:00100000:3.0:1789127381.816090:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789127381.816096:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789484288:0@lo:400:kworker.0 00000100:00100000:2.0:1789127381.816101:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127381.816123:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127381.816125:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789484544:0@lo:400:kworker.0 00000100:00100000:3.0:1789127381.816140:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789484800:0@lo:400:kworker.0 00000100:00100000:2.0:1789127381.816146:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127381.816160:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127381.816163:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789485056:0@lo:400:kworker.0 00000100:00100000:3.0:1789127381.816174:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789485312:0@lo:400:kworker.0 00000100:00100000:2.0:1789127381.816188:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127381.816193:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127381.816202:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789485568:0@lo:400:kworker.0 00000100:00100000:2.0:1789127381.816223:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127381.816225:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789484160 00000100:00100000:2.0:1789127381.816243:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789127381.816248:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789484416:0@lo:400:kworker.0 00000100:00100000:2.0:1789127381.816270:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127381.816281:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789484928:0@lo:400:kworker.0 00000100:00100000:2.0:1789127381.816301:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127381.816317:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789485440:0@lo:400:kworker.0 00000100:00100000:2.0:1789127381.816339:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127381.816375:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789484672 00000100:00100000:3.0:1789127381.816378:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789484160 00000100:00100000:2.0:1789127381.816379:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789484672 00000100:00100000:2.0:1789127381.816440:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789485184 00000100:00100000:2.0:1789127381.816443:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789485184 00000100:00100000:0.0:1789127381.816449:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789485056 00000100:00100000:0.0:1789127381.816452:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789485056 00000100:00100000:0.0:1789127381.816482:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789485568 00000100:00100000:0.0:1789127381.816485:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789485568 00000100:00100000:0.0:1789127381.816499:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789484928 00000100:00100000:0.0:1789127381.816502:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789484928 00000100:00100000:0.0:1789127381.816534:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789485440 00000100:00100000:0.0:1789127381.816537:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789485440 00000100:00100000:0.0:1789127381.816553:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789127381.816564:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789485056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127381.816650:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789485056:12345-0@lo:400:kworker.0 Request processed in 87us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127381.816658:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789127381.816676:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789127381.816684:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789485568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127381.816711:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789485568:12345-0@lo:400:kworker.0 Request processed in 30us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127381.816718:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789127381.816728:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789127381.816734:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789484928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127381.816760:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eba580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789484928:12345-0@lo:400:kworker.0 Request processed in 26us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127381.816766:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789127381.816777:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789127381.816783:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789485440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127381.816822:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789485440:12345-0@lo:400:kworker.0 Request processed in 39us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127381.816830:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1789127381.818093:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b08f00 x1876035789484928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127381.818114:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b08f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789484928:0@lo:400:kworker.0 00010000:00080000:1.0:1789127381.818128:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b0b480 x1876035789485440/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127381.818148:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789485440:0@lo:400:kworker.0 00010000:00080000:1.0:1789127381.818163:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b0a580 x1876035789485056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127381.818171:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789485056:0@lo:400:kworker.0 00010000:00080000:1.0:1789127381.818183:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b08780 x1876035789485568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127381.818191:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b08780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789485568:0@lo:400:kworker.0 00000100:00100000:3.0:1789127381.821649:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789484800 00000100:00100000:3.0:1789127381.821669:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789484800 00000100:00100000:3.0:1789127381.821704:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789485312 00000100:00100000:3.0:1789127381.821707:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789485312 00000100:00100000:3.0:1789127381.821722:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789484416 00000100:00100000:3.0:1789127381.821724:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789484416 00000100:00100000:3.0:1789127381.821744:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789127381.821756:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789484672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127381.821888:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789484672:12345-0@lo:400:kworker.0 Request processed in 135us (5881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127381.821897:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789127381.821929:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789127381.821936:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789484160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127381.821967:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789484160:12345-0@lo:400:kworker.0 Request processed in 33us (6071us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127381.821974:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789127381.821988:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789127381.821993:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789484800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127381.822022:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789484800:12345-0@lo:400:kworker.0 Request processed in 28us (5861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127381.822028:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789127381.822038:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789127381.822044:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789485312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127381.822070:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789485312:12345-0@lo:400:kworker.0 Request processed in 26us (5876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127381.822075:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789127381.822110:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789127381.822116:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789484416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127381.822162:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789484416:12345-0@lo:400:kworker.0 Request processed in 46us (5890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127381.822168:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789127381.822199:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789484288 00000100:00100000:3.0:1789127381.822204:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789484288 00000100:00100000:3.0:1789127381.822231:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789484544 00000100:00100000:3.0:1789127381.822234:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789484544 00010000:00080000:0.0:1789127381.822407:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b0a940 x1876035789484800/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127381.822425:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789484800:0@lo:400:kworker.0 00010000:00080000:0.0:1789127381.822439:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b092c0 x1876035789485312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127381.822449:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789485312:0@lo:400:kworker.0 00000100:00100000:0.0:1789127381.822463:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789484160:0@lo:400:kworker.0 00000100:00100000:0.0:1789127381.822476:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789484672:0@lo:400:kworker.0 00000100:00100000:2.0:1789127381.822611:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789127381.822621:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789485184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127381.822751:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789127381.822760:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789484288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127381.822789:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789485184:12345-0@lo:400:kworker.0 Request processed in 169us (6731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127381.822796:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789484288:12345-0@lo:400:kworker.0 Request processed in 38us (6672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127381.822796:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789127381.822801:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789127381.822813:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789127381.822820:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789484544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127381.822846:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789484544:12345-0@lo:400:kworker.0 Request processed in 28us (6699us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127381.822852:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789127381.822870:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789484032 00000100:00100000:2.0:1789127381.822875:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789484032 00000100:00100000:2.0:1789127381.822903:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789127381.822910:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789484032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127381.822914:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789485696:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127381.822943:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789484032:12345-0@lo:400:kworker.0 Request processed in 35us (6842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127381.822950:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789127381.822954:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127381.822978:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789485696 00000100:00100000:2.0:1789127381.822982:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789485696 00000100:00100000:0.0:1789127381.822991:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789484288:0@lo:400:kworker.0 00000100:00100000:2.0:1789127381.823003:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789127381.823004:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789485184:0@lo:400:kworker.0 00000100:00100000:2.0:1789127381.823008:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789485696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789127381.823035:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789127381.823081:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789485696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127381.823087:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789127381.823104:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eb8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789485696:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1789127381.823120:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127381.823126:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127381.823130:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127381.823132:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127381.823220:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127381.823229:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789485824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127381.823271:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127381.823446:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789485952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127381.823475:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127381.823601:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789485824 00000100:00100000:0.0:1789127381.823605:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789485824 00000100:00100000:0.0:1789127381.823635:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789485952 00000100:00100000:0.0:1789127381.823645:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789485952 00000100:00100000:0.0:1789127381.823659:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789127381.823665:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789485824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789127381.823686:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127381.823719:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789485824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127381.823725:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789127381.823737:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789127381.823742:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7deda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789485952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127381.823751:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127381.823773:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7deda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789485952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127381.823779:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:0.0:1789127381.823802:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebb0c0 x1876035789485952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127381.823816:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789485952:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789127381.823835:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587eba940 x1876035789485824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127381.823846:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789485824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127381.824823:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789484416:0@lo:400:kworker.0 00000100:00100000:0.0:1789127381.824839:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789484032:0@lo:400:kworker.0 00000100:00100000:0.0:1789127381.824849:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789484544:0@lo:400:kworker.0 00010000:00010000:3.0:1789127381.945409:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127382.327661:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789127382.327683:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789486080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127382.327746:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127382.327818:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789486208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127382.327867:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127382.327897:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789486080 00000100:00100000:3.0:1789127382.327903:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789486080 00000100:00100000:3.0:1789127382.327942:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789486208 00000100:00100000:3.0:1789127382.327946:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789486208 00000100:00100000:3.0:1789127382.327961:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789127382.327969:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7def840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789486080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127382.327997:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127382.328039:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7def840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789486080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127382.328054:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789127382.328071:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789127382.328077:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789486208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127382.328087:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127382.328110:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dec780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789486208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127382.328116:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1789127382.328151:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebf840 x1876035789486080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127382.328169:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789486080:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789127382.328182:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7dee1c0 x1876035789486208/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127382.328193:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dee1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789486208:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789127382.967828:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127383.993264:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127384.582749:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127384.582797:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127384.582822:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127384.582927:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771581568 00000100:00100000:0.0:1789127384.582943:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771581568 00000100:00100000:0.0:1789127384.582989:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 313 00000100:00100000:0.0:1789127384.582999:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771581568:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127384.583063:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771581568:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 65us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127384.583071:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 313 00000100:00100000:2.0:1789127384.583447:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127384.583501:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127384.583548:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771581824 00000100:00100000:2.0:1789127384.583553:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771581824 00000100:00100000:0.0:1789127384.583646:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771582080 00000100:00100000:0.0:1789127384.583651:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771582080 00000100:00100000:0.0:1789127384.583694:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771581696 00000100:00100000:0.0:1789127384.583697:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771581696 00000100:00100000:0.0:1789127384.583710:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771581952 00000100:00100000:0.0:1789127384.583712:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771581952 00000100:00100000:0.0:1789127384.583727:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 178 00000100:00100000:0.0:1789127384.583734:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771582080:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127384.583774:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771582080:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 40us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127384.583780:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 178 00000100:00100000:0.0:1789127384.583794:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 179 00000100:00100000:0.0:1789127384.583800:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771581696:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127384.583824:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771581696:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 26us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127384.583830:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 179 00000100:00100000:0.0:1789127384.584398:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 180 00000100:00100000:0.0:1789127384.584410:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771581952:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127384.584442:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771581952:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 36us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127384.584457:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 180 00000100:00100000:2.0:1789127384.584572:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 181 00000100:00100000:2.0:1789127384.584581:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771581824:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127384.584612:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771581824:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 33us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127384.584618:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 181 00000100:00080000:2.0:1789127384.584647:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127384.584651:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:1.0:1789127384.767619:0:13047:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1789127384.901204:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 62f6ff54-d308-4b3f-88aa-10f2416ee4e9 00000020:00000080:1.0:1789127384.901213:0:8433:0:(genops.c:885:class_export_put()) final put ffff934587fd6800/62f6ff54-d308-4b3f-88aa-10f2416ee4e9 00000020:00000080:2.0:1789127384.902805:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff934587fd6800/62f6ff54-d308-4b3f-88aa-10f2416ee4e9 for lustre-OST0000 00000020:00000080:2.0:1789127384.902881:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934587fd1000 for lustre-OST0000 00000001:00100000:2.0:1789127384.903625:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 62f6ff54-d308-4b3f-88aa-10f2416ee4e9 00000020:00000080:2.0:1789127384.903630:0:9519:0:(genops.c:885:class_export_put()) final put ffff934587fd7000/62f6ff54-d308-4b3f-88aa-10f2416ee4e9 00000020:00000080:0.0:1789127384.903706:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff934587fd7000/62f6ff54-d308-4b3f-88aa-10f2416ee4e9 for lustre-OST0001 00000020:00000080:0.0:1789127384.903751:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934587fd6000 for lustre-OST0001 00010000:00010000:3.0:1789127385.019197:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127386.039651:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127386.424740:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127386.424762:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789486336:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127386.424831:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.424893:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789486336 00000100:00100000:3.0:1789127386.424900:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789486336 00000100:00100000:3.0:1789127386.424944:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789127386.424953:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789486336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127386.424989:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789127386.425033:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789486336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.425041:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789127386.425086:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789486336:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127386.935715:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789486464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127386.935781:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127386.935850:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789486464 00000100:00100000:0.0:1789127386.935857:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789486464 00000100:00100000:0.0:1789127386.935906:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789127386.935915:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789486464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789127386.935943:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127386.935984:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789486464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127386.935991:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1789127386.936010:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789127386.936040:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587fb3840 x1876035789486464/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127386.936057:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789486464:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127386.936371:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789486592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127386.936398:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.937703:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ded2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789486848:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.937748:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.937777:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789487360:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.937801:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.937818:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789487872:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.937840:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.937861:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789127386.937867:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789486976:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.937890:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.937907:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789487488:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.937928:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.937944:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789488000:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.937966:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.938001:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789486848 00000100:00100000:3.0:1789127386.938006:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789486848 00000100:00100000:3.0:1789127386.938044:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789127386.938123:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789486848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.938167:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789486848:12345-0@lo:400:kworker.0 Request processed in 47us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.938175:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789127386.938203:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789487360 00000100:00100000:3.0:1789127386.938207:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789487360 00000100:00100000:3.0:1789127386.938229:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789127386.938235:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789487360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.938268:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789487360:12345-0@lo:400:kworker.0 Request processed in 33us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.938274:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789127386.938290:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789487872 00000100:00100000:3.0:1789127386.938294:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789487872 00000100:00100000:3.0:1789127386.938327:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789127386.938333:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789487872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.938362:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789487872:12345-0@lo:400:kworker.0 Request processed in 29us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.938368:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789127386.938385:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789486976 00000100:00100000:3.0:1789127386.938389:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789486976 00000100:00100000:3.0:1789127386.938410:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789487488 00000100:00100000:3.0:1789127386.938413:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789487488 00000100:00100000:3.0:1789127386.938428:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789488000 00000100:00100000:3.0:1789127386.938431:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789488000 00000100:00100000:3.0:1789127386.938443:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789127386.938448:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789486976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.938484:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789486976:12345-0@lo:400:kworker.0 Request processed in 35us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.938490:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1789127386.938503:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789127386.938527:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789487488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.938684:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789487488:12345-0@lo:400:kworker.0 Request processed in 174us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.938691:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1789127386.938704:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789127386.938711:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789488000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.938737:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789488000:12345-0@lo:400:kworker.0 Request processed in 28us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.938743:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789127386.938748:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789487104:0@lo:400:kworker.0 00000100:00080000:3.0:1789127386.938774:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127386.938777:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789127386.938778:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127386.938791:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789487104 00000100:00100000:3.0:1789127386.938794:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789487104 00000100:00100000:0.0:1789127386.938796:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789487616:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.938815:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789127386.938815:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.938821:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789487104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127386.938828:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789488128:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.938850:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789487104:12345-0@lo:400:kworker.0 Request processed in 29us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127386.938854:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.938856:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789127386.938870:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789487616 00000100:00100000:3.0:1789127386.938873:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789487616 00000100:00100000:0.0:1789127386.938885:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789487104:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.938893:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789488128 00000100:00100000:3.0:1789127386.938895:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789488128 00000100:00100000:0.0:1789127386.938898:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789127386.938904:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789486720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127386.938909:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789127386.938921:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789487616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127386.938924:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127386.938938:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789487232:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.938947:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789487616:12345-0@lo:400:kworker.0 Request processed in 28us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.938952:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789127386.938956:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127386.938962:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789487232 00000100:00100000:0.0:1789127386.938964:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789487744:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.938965:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789487232 00000100:00100000:3.0:1789127386.938977:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789127386.938982:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789488128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127386.938982:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789127386.939002:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca43c0 x1876035789487616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127386.939005:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789488128:12345-0@lo:400:kworker.0 Request processed in 23us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.939011:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789127386.939013:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789487616:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.939021:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00010000:00080000:0.0:1789127386.939022:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca4780 x1876035789488128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127386.939026:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789487232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127386.939031:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789488128:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.939149:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789487232:12345-0@lo:400:kworker.0 Request processed in 121us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.939156:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789127386.939182:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789487232:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.939197:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789486720 00000100:00100000:3.0:1789127386.939200:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789486720 00000100:00100000:3.0:1789127386.939220:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789127386.939226:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789486720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127386.939246:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789127386.939282:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789486720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127386.939288:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1789127386.939304:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127386.939332:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789486720:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127386.939363:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789486976:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.939373:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789487488:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.939383:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789488000:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.939392:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ded2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789486848:0@lo:400:kworker.0 00000100:00100000:3.0:1789127386.939401:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789487360:0@lo:400:kworker.0 00010000:00080000:3.0:1789127386.939410:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca61c0 x1876035789487872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127386.939420:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789487872:0@lo:400:kworker.0 00000100:00100000:2.0:1789127386.939697:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789487744 00000100:00100000:2.0:1789127386.939702:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789487744 00000100:00100000:2.0:1789127386.939738:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789127386.939745:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789487744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127386.939785:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789487744:12345-0@lo:400:kworker.0 Request processed in 42us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127386.939791:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1789127386.939822:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca5e00 x1876035789487744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127402 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127386.939837:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789487744:0@lo:400:kworker.0 00000100:00080000:3.0:1789127386.940281:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127386.943048:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789486592 00000100:00100000:1.0:1789127386.943062:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789486592 00000100:00080000:3.0:1789127386.943136:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127386.943136:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789127386.943146:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789486592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789127386.943170:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127386.943263:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789486592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (6863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127386.943271:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1789127386.943540:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebde00 x1876035789486592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127402 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127386.943572:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789486592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789127387.064239:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127387.447694:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127387.447715:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789488256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127387.447778:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127387.447846:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789488384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127387.447870:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127387.447909:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789488256 00000100:00100000:3.0:1789127387.447916:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789488256 00000100:00100000:3.0:1789127387.447959:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789488384 00000100:00100000:3.0:1789127387.447962:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789488384 00000100:00100000:2.0:1789127387.447975:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789127387.447990:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7388b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789488256:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127387.447996:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789127387.448005:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7389e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789488384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127387.448019:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1789127387.448020:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127387.448075:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7388b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789488256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127387.448082:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789127387.448179:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7389e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789488384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 175us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127387.448186:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:3.0:1789127387.448293:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b738a580 x1876035789488256/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127387.448311:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789488256:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1789127387.448466:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebc3c0 x1876035789488384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127387.448480:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789488384:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1789127387.900135:0:13195:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc138ca80 20000000:00000080:1.0:1789127387.900151:0:13195:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9346b7e8c800 uarg=0000000000000000 20000000:01000000:1.0:1789127387.900188:0:13195:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789127387.900193:0:13195:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1789127387.900197:0:13195:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789127387.907800:0:13196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789127387.907968:0:13195:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789127387.915007:0:13195:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789127387.915036:0:13195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.915055:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93468501ae00/0xd718aadfd785d607 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb00 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.915064:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93468501b000/0xd718aadfd785d615 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d60e expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.915088:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928ff000/0xd718aadfd785d623 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d61c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.915096:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93468501b600/0xd718aadfd785d631 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d62a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.915103:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d63f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d638 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.915111:0:13195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93468501b800/0xd718aadfd785d654 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb3f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.915119:0:13195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.915155:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93468501b800/0xd718aadfd785d654 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb3f expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.915170:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93468501b800/0xd718aadfd785d654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb3f expref: 12 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127387.915184:0:13195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1876035789488512:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127387.915283:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d63f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d638 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.915292:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d63f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d638 expref: 23 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127387.915301:0:13195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1876035789488640:0@lo:104: 00000100:00100000:0.0:1789127387.915368:0:13195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127387.915412:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93468501b600/0xd718aadfd785d631 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d62a expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.915421:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93468501b600/0xd718aadfd785d631 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d62a expref: 23 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127387.915430:0:13195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1876035789488768:0@lo:104: 00000100:00100000:0.0:1789127387.915450:0:13195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127387.915479:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928ff000/0xd718aadfd785d623 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d61c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.915487:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928ff000/0xd718aadfd785d623 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d61c expref: 23 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127387.915496:0:13195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb1a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1876035789488896:0@lo:104: 00000100:00100000:0.0:1789127387.915558:0:13195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127387.915580:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93468501b000/0xd718aadfd785d615 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d60e expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.915588:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93468501b000/0xd718aadfd785d615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d60e expref: 23 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127387.915596:0:13195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1876035789489024:0@lo:104: 00000100:00100000:0.0:1789127387.915616:0:13195:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127387.915637:0:13195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93468501ae00/0xd718aadfd785d607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb00 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.915646:0:13195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93468501ae00/0xd718aadfd785d607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb00 expref: 12 pid: 6517 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127387.915665:0:13195:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1876035789489152:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127387.915687:0:13195:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b5414480 going to sleep for 11 seconds 00000100:00100000:1.0:1789127387.915917:0:10403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789488640 00000100:00100000:1.0:1789127387.915931:0:10403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789488640 00000100:00100000:1.0:1789127387.915967:0:10403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789488768 00000100:00100000:1.0:1789127387.915970:0:10403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789488768 00000100:00100000:1.0:1789127387.915980:0:10403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789488896 00000100:00100000:1.0:1789127387.915982:0:10403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789488896 00000100:00100000:1.0:1789127387.915990:0:10403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789489024 00000100:00100000:1.0:1789127387.915992:0:10403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789489024 00000100:00100000:1.0:1789127387.916003:0:10403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789127387.916011:0:10403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:13195:x1876035789488640:12345-0@lo:104: 00010000:00010000:1.0:1789127387.916033:0:10403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d63f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.916086:0:10403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127387.916092:0:10403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:13195:x1876035789488640:12345-0@lo:104: Request processed in 82us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127387.916099:0:10403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789127387.916118:0:10403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789127387.916125:0:10403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:13195:x1876035789488768:12345-0@lo:104: 00010000:00010000:1.0:1789127387.916133:0:10403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d631 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.916168:0:10403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789127387.916173:0:10403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:13195:x1876035789488768:12345-0@lo:104: Request processed in 50us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127387.916179:0:10403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789127387.916191:0:10403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789127387.916197:0:10403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:13195:x1876035789488896:12345-0@lo:104: 00010000:00010000:1.0:1789127387.916205:0:10403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d623 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.916252:0:10403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789127387.916257:0:10403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:13195:x1876035789488896:12345-0@lo:104: Request processed in 61us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127387.916263:0:10403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789127387.916275:0:10403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789127387.916281:0:10403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:13195:x1876035789489024:12345-0@lo:104: 00010000:00010000:1.0:1789127387.916288:0:10403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d615 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.916367:0:10403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789127387.916372:0:10403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:13195:x1876035789489024:12345-0@lo:104: Request processed in 92us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127387.916378:0:10403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1789127387.916396:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789127387.916401:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d63f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.916408:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b200 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127387.916412:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d63f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.916421:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d63f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127387.916429:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d63f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127387.916434:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127387.916472:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d63f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.916480:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127387.916500:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d63f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.916528:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93468501b200/0xd718aadfd785d638 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d63f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.917941:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789127387.917949:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d631 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.917958:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b400 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127387.917961:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d631 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.917970:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d631 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127387.917977:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d631 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127387.917983:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127387.918010:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d631 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.918017:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127387.918038:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d631 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.918057:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93468501b400/0xd718aadfd785d62a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d631 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.918068:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127387.918071:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d623 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.918076:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501aa00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127387.918081:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d623 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.918087:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d623 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127387.918093:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d623 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127387.918098:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127387.918111:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d623 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.918116:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127387.918122:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d623 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.918127:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93468501aa00/0xd718aadfd785d61c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d623 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.918135:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127387.918144:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d615 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.918149:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff600 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127387.918151:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d615 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.918159:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d615 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127387.918164:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d615 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127387.918168:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127387.918181:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d615 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.918185:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127387.918191:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d615 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.918196:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928ff600/0xd718aadfd785d60e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d615 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127387.918209:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127387.918210:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127387.918212:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127387.918222:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127387.918228:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127387.918254:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789489280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127387.918322:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127387.918377:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127387.918384:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789489664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127387.918406:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127387.918433:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789489408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127387.918454:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127387.918471:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127387.918476:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789489536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127387.918495:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127387.922587:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789489280 00000100:00100000:2.0:1789127387.922602:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789489280 00010000:00010000:2.0:1789127387.922642:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d63f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d638 expref: 24 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127387.922669:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789489664 00000100:00100000:2.0:1789127387.922672:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789489664 00010000:00010000:2.0:1789127387.922685:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93468501b000/0xd718aadfd785d615 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d60e expref: 25 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127387.922695:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789489408 00000100:00100000:2.0:1789127387.922698:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789489408 00010000:00010000:2.0:1789127387.922707:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93468501b600/0xd718aadfd785d631 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d62a expref: 26 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127387.922717:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789489536 00000100:00100000:2.0:1789127387.922732:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789489536 00010000:00010000:2.0:1789127387.922749:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928ff000/0xd718aadfd785d623 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d61c expref: 27 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127387.922764:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127387.922773:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+27:3651:x1876035789489280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127387.922787:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127387.922792:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d63f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d638 expref: 27 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.922802:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d63f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d638 expref: 27 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.922820:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127387.922900:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+27:3651:x1876035789489280:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (4588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127387.922907:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127387.922924:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789127387.922929:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+26:3651:x1876035789489664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127387.922936:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127387.922940:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93468501b000/0xd718aadfd785d615 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d60e expref: 26 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.922948:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93468501b000/0xd718aadfd785d615 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d60e expref: 26 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.922957:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127387.922981:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0bc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+26:3651:x1876035789489664:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (4574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127387.922986:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789127387.923005:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127387.923011:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+25:3652:x1876035789489408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127387.923019:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127387.923023:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93468501b600/0xd718aadfd785d631 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d62a expref: 25 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.923031:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93468501b600/0xd718aadfd785d631 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d62a expref: 25 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.923039:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127387.923069:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b083c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+25:3652:x1876035789489408:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (4614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127387.923076:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127387.923088:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789127387.923094:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789489536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127387.923101:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127387.923105:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928ff000/0xd718aadfd785d623 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d61c expref: 24 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.923112:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928ff000/0xd718aadfd785d623 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d61c expref: 24 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.923121:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127387.923143:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789489536:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (4647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127387.923149:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789127387.923194:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789489536:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127387.923206:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789489408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127387.923408:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789489664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127387.923417:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789489280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127387.923709:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d63f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d638 expref: 23 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127387.923721:0:13195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb0b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1876035789488640:0@lo:104: 00010000:00010000:0.0:1789127387.923732:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501b600/0xd718aadfd785d631 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d62a expref: 22 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127387.923740:0:13195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb3c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1876035789488768:0@lo:104: 00010000:00010000:0.0:1789127387.923748:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928ff000/0xd718aadfd785d623 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d61c expref: 21 pid: 6514 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127387.923756:0:13195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb1a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1876035789488896:0@lo:104: 00010000:00010000:0.0:1789127387.923764:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501b000/0xd718aadfd785d615 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d60e expref: 20 pid: 6517 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127387.923771:0:13195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca5e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1876035789489024:0@lo:104: 00000100:00100000:2.0:1789127387.930011:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127387.930061:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127387.930094:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771582208 00000100:00100000:2.0:1789127387.930101:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771582208 00010000:00010000:2.0:1789127387.930134:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93468501b800/0xd718aadfd785d654 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb3f expref: 13 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127387.930159:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771582336 00000100:00100000:2.0:1789127387.930161:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771582336 00010000:00010000:2.0:1789127387.930171:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93468501ae00/0xd718aadfd785d607 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb00 expref: 14 pid: 6517 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127387.930187:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:2.0:1789127387.930194:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+14:2402:x1876035771582208:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127387.930206:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127387.930211:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93468501b800/0xd718aadfd785d654 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb3f expref: 14 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.930223:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93468501b800/0xd718aadfd785d654 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb3f expref: 14 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.930242:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127387.930282:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+14:2402:x1876035771582208:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 88us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127387.930289:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:2.0:1789127387.930304:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00010000:00010000:0.0:1789127387.930402:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501b800/0xd718aadfd785d654 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb3f expref: 13 pid: 6514 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127387.930414:0:13195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1876035789488512:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127387.930423:0:13195:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13195:1876035789489152:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127387.930453:0:13195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127387.930597:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9deb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:2402:x1876035771582336:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127387.930607:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127387.930616:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93468501ae00/0xd718aadfd785d607 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb00 expref: 12 pid: 6517 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.930625:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93468501ae00/0xd718aadfd785d607 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb00 expref: 12 pid: 6517 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.930635:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501ae00/0xd718aadfd785d607 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb00 expref: 12 pid: 6517 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.930646:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.930654:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.930667:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.930673:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.930680:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.930687:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.930693:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec200 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127387.930696:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.930703:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.930725:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127387.930741:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127387.930758:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9deb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:2402:x1876035771582336:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 448us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127387.930765:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00010000:00010000:0.0:1789127387.930913:0:13195:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.930922:0:13195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127387.930928:0:13195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587fec200/0xd718aadfd785d677 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127388.107218:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127389.114027:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127389.376334:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127389.376546:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771582464 00000100:00100000:2.0:1789127389.376555:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771582464 00000100:00100000:2.0:1789127389.376606:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 315 00000100:00100000:2.0:1789127389.376616:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:6173:x1876035771582464:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127389.376630:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127389.376648:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928fe800/0xd718aadfd785d67e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffb70 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127389.376674:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928fe800/0xd718aadfd785d67e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb70 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127389.376685:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928fe800/0xd718aadfd785d67e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb70 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127389.376694:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe800, rc 0) 00000100:00100000:2.0:1789127389.376745:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771582464:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 131us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127389.376752:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 315 00000100:00100000:2.0:1789127389.381303:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127389.381415:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771582592 00000100:00100000:3.0:1789127389.381425:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771582592 00000100:00100000:3.0:1789127389.381478:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 316 00000100:00100000:3.0:1789127389.381487:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771582592:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127389.381668:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771582592:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 182us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127389.381677:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 316 00000100:00100000:0.0:1789127389.392945:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127389.393009:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771582720 00000100:00100000:3.0:1789127389.393019:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771582720 00000100:00100000:3.0:1789127389.393074:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 317 00000100:00100000:3.0:1789127389.393084:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771582720:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127389.393241:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771582720:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 157us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127389.393249:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 317 00000100:00100000:0.0:1789127389.406199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127389.406323:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771582848 00000100:00100000:1.0:1789127389.406333:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771582848 00000100:00100000:1.0:1789127389.406388:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 318 00000100:00100000:1.0:1789127389.406398:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934688ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771582848:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127389.406414:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127389.406430:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93458858c400/0xd718aadfd785d685 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffb77 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127389.406458:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93458858c400/0xd718aadfd785d685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb77 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127389.406469:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93458858c400/0xd718aadfd785d685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb77 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127389.406480:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c400, rc 0) 00000100:00100000:1.0:1789127389.406567:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934688ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771582848:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 170us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127389.406582:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 318 00000100:00100000:1.0:1789127389.422670:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127389.423014:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771582976 00000100:00100000:0.0:1789127389.423024:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771582976 00000100:00100000:0.0:1789127389.423091:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 319 00000100:00100000:0.0:1789127389.423102:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934688ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771582976:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127389.423248:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934688ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771582976:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 147us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127389.423257:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 319 00000100:00100000:0.0:1789127389.430366:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127389.434559:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771583104 00000100:00100000:1.0:1789127389.434574:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771583104 10000000:01000000:2.0:1789127389.434636:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127389.434652:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934586ebc000 from 7 10000000:01000000:2.0:1789127389.434656:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127389.434698:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127389.434709:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127389.434720:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127389.434745:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789489792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127389.434810:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127389.434872:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72d8000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127389.434920:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789489792 00000100:00100000:2.0:1789127389.434924:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789489792 00000100:00100000:2.0:1789127389.434942:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 320 00000100:00100000:2.0:1789127389.434950:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771583104:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127389.435170:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789127389.435179:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789489792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127389.435187:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127389.435200:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fed800/0xd718aadfd785d693 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d68c expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127389.435219:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fed800/0xd718aadfd785d693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d68c expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127389.435237:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fed800/0xd718aadfd785d693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d68c expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127389.435246:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fed800, rc 0) 00000100:00100000:0.0:1789127389.435283:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789489792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127389.435289:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1789127389.435330:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789489792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127389.435344:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d693 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127389.435353:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d693 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127389.435407:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789489920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127389.435431:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127389.435443:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b5414240 going to sleep for 11 seconds 00000100:00100000:0.0:1789127389.435453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789489920 00000100:00100000:0.0:1789127389.435456:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789489920 00000100:00100000:0.0:1789127389.435471:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789127389.435476:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789489920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127389.435574:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789489920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127389.435581:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1789127389.435604:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789489920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127389.435637:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127389.435694:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127389.435705:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b5414240 going to sleep for 11 seconds 00000100:00100000:0.0:1789127389.435779:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789490048 00000100:00100000:0.0:1789127389.435782:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789490048 00000100:00100000:0.0:1789127389.435796:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789127389.435801:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789490048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127389.435857:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789490048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 55us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127389.435863:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1789127389.435893:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127389.436146:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771583104:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 1194us (5786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127389.436154:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 320 00000040:00080000:0.0:1789127389.437185:0:13251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789127389.437527:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789127389.437573:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127389.437584:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d693 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127389.437595:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d693 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127389.437619:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127389.437622:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b6688800 from 7 10000000:01000000:2.0:1789127389.437624:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127389.437656:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127389.437663:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127389.437673:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127389.437696:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127389.437749:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127389.437784:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72d8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127389.438225:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789490176 00000100:00100000:0.0:1789127389.438232:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789490176 00000100:00100000:0.0:1789127389.438280:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789127389.438289:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789490176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127389.438301:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127389.438313:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fec400/0xd718aadfd785d6a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d69a expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127389.438335:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fec400/0xd718aadfd785d6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d69a expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127389.438344:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fec400/0xd718aadfd785d6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d69a expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127389.438353:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec400, rc 0) 00000100:00100000:0.0:1789127389.438402:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789490176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127389.438409:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1789127389.438450:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127389.438463:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6a1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127389.438470:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d6a1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127389.438549:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127389.438574:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127389.438590:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127389.438602:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789490304 00000100:00100000:0.0:1789127389.438605:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789490304 00000100:00100000:0.0:1789127389.438627:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:0.0:1789127389.438633:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789490304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127389.440179:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789490304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1538us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127389.440191:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789127389.440241:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca5e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127389.440284:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127389.440340:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127389.440376:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72d8540 going to sleep for 11 seconds 00000100:00100000:0.0:1789127389.444370:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789490432 00000100:00100000:0.0:1789127389.444384:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789490432 00000100:00100000:0.0:1789127389.444448:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1789127389.444458:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789490432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127389.444625:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789490432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (4284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127389.444633:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789127389.444945:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789127389.445808:0:13252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789127389.447040:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789127389.447128:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127389.447140:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6a1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127389.447151:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6a1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127389.447163:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789127389.447165:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b640b000 from 7 10000000:01000000:0.0:1789127389.447168:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127389.447203:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127389.447211:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127389.447221:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127389.447244:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127389.447307:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127389.447355:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127389.447825:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789490560 00000100:00100000:2.0:1789127389.447832:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789490560 00000100:00100000:2.0:1789127389.447883:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1789127389.447892:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789490560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127389.447905:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127389.447924:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6af lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d6a8 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127389.447947:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d6a8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127389.447957:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d6a8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127389.447965:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff600, rc 0) 00000100:00100000:2.0:1789127389.448019:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789490560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127389.448026:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789127389.448179:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca4780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127389.448195:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127389.448204:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d6af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127389.448269:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127389.448299:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127389.448329:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687b13180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127389.448379:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789490688 00000100:00100000:0.0:1789127389.448384:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789490688 00000100:00100000:0.0:1789127389.448419:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1789127389.448427:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789490688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127389.448565:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789490688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127389.448572:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1789127389.448753:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127389.448782:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127389.448818:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127389.448844:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687b13180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127389.449193:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789490816 00000100:00100000:0.0:1789127389.449198:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789490816 00000100:00100000:0.0:1789127389.449265:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1789127389.449273:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789490816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127389.449369:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789490816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127389.449377:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1789127389.449452:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789127389.456979:0:13253:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789127389.457279:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789127389.457302:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127389.457312:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127389.457324:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127389.457344:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789127389.457347:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934687bf9800 from 7 10000000:01000000:1.0:1789127389.457349:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789127389.457383:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127389.457391:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127389.457400:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127389.457423:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127389.457489:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127389.457552:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687b13180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127389.457571:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789490944 00000100:00100000:1.0:1789127389.457576:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789490944 00000100:00100000:1.0:1789127389.457615:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789127389.457623:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789490944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127389.457635:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127389.457647:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93458858da00/0xd718aadfd785d6bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d6b6 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127389.457683:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93458858da00/0xd718aadfd785d6bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d6b6 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127389.457694:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93458858da00/0xd718aadfd785d6bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d6b6 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127389.457712:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858da00, rc 0) 00000100:00100000:1.0:1789127389.457748:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789490944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127389.457755:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1789127389.457794:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789490944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127389.457808:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127389.457817:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d6bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127389.457865:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789491072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127389.457888:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127389.457899:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687b13180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127389.457909:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789491072 00000100:00100000:1.0:1789127389.457912:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789491072 00000100:00100000:1.0:1789127389.457928:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789127389.457933:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789491072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127389.458022:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789491072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127389.458029:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1789127389.458055:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789491072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127389.458200:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789491200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127389.458239:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127389.458258:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687b13180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127389.458270:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789491200 00000100:00100000:1.0:1789127389.458273:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789491200 00000100:00100000:1.0:1789127389.458290:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789127389.458296:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789491200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127389.458364:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789491200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 68us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127389.458371:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1789127389.458407:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b092c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789491200:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789127389.459420:0:13254:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789127389.467552:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789127389.467592:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127389.467603:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127389.467617:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127389.705809:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127389.705847:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127389.705876:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127389.705899:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127389.705928:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771583232 00000100:00100000:1.0:1789127389.705937:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771583232 00000100:00100000:1.0:1789127389.705986:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771583488 00000100:00100000:1.0:1789127389.705989:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771583488 00000100:00100000:1.0:1789127389.706001:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771583360 00000100:00100000:1.0:1789127389.706003:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771583360 00000100:00100000:1.0:1789127389.706013:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771583616 00000100:00100000:1.0:1789127389.706015:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771583616 00000100:00100000:1.0:1789127389.706040:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 188 00000100:00100000:1.0:1789127389.706062:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771583232:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127389.706132:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771583232:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 84us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127389.706139:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 188 00000100:00100000:1.0:1789127389.706155:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 189 00000100:00100000:1.0:1789127389.706161:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771583488:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127389.706180:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771583488:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 20us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127389.706185:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 189 00000100:00100000:1.0:1789127389.706194:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 190 00000100:00100000:1.0:1789127389.706199:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771583360:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127389.706219:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b08780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771583360:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 20us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127389.706226:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 190 00000100:00100000:1.0:1789127389.706236:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 191 00000100:00100000:1.0:1789127389.706243:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771583616:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127389.706264:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771583616:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 22us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127389.706269:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 191 00000100:00080000:1.0:1789127389.706287:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127389.706290:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789127390.136526:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127391.159693:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127391.548960:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127391.548984:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789491328:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127391.549056:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127391.549126:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789491328 00000100:00100000:3.0:1789127391.549133:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789491328 00000100:00100000:3.0:1789127391.549178:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789127391.549187:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b738b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789491328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127391.549224:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789127391.549270:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b738b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789491328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127391.549277:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789127391.549325:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789491328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127392.058269:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789491456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127392.058332:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127392.058402:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789491456 00000100:00100000:1.0:1789127392.058409:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789491456 00000100:00100000:1.0:1789127392.058459:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789127392.058468:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789491456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789127392.058494:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127392.058561:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b08f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789491456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127392.058569:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1789127392.058588:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789127392.058615:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587b0b480 x1876035789491456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127392.058647:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789491456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127392.059038:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789491712:0@lo:400:kworker.0 00000100:00100000:1.0:1789127392.059069:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127392.059089:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789492224:0@lo:400:kworker.0 00000100:00100000:1.0:1789127392.059111:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127392.059126:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789492736:0@lo:400:kworker.0 00000100:00100000:1.0:1789127392.059145:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127392.059166:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789127392.059171:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789491840:0@lo:400:kworker.0 00000100:00100000:1.0:1789127392.059192:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127392.059207:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789492352:0@lo:400:kworker.0 00000100:00100000:1.0:1789127392.059227:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127392.059270:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789492864:0@lo:400:kworker.0 00000100:00100000:1.0:1789127392.059291:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127392.059313:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789491712 00000100:00100000:1.0:1789127392.059317:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789491712 00000100:00100000:1.0:1789127392.059339:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789492224 00000100:00100000:1.0:1789127392.059341:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789492224 00000100:00100000:1.0:1789127392.059361:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789492736 00000100:00100000:1.0:1789127392.059364:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789492736 00000100:00100000:1.0:1789127392.059376:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789492352 00000100:00100000:1.0:1789127392.059378:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789492352 00000100:00100000:1.0:1789127392.059390:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789492864 00000100:00100000:1.0:1789127392.059393:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789492864 00000100:00100000:1.0:1789127392.059406:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789127392.059412:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789491712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127392.059447:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f0a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789491712:12345-0@lo:400:kworker.0 Request processed in 34us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127392.059453:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789127392.059466:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789127392.059473:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586046940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789492224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127392.059498:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586046940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789492224:12345-0@lo:400:kworker.0 Request processed in 26us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127392.059504:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789127392.059550:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789127392.059556:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586044780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789492736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127392.059590:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586044780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789492736:12345-0@lo:400:kworker.0 Request processed in 35us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127392.059595:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789127392.059605:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789127392.059618:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586047840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789492352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127392.059644:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586047840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789492352:12345-0@lo:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127392.059651:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789127392.059664:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789127392.059670:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789492864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127392.059692:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586045e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789492864:12345-0@lo:400:kworker.0 Request processed in 24us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127392.059697:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789127392.059721:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789491840 00000100:00100000:1.0:1789127392.059724:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789491840 00000100:00100000:1.0:1789127392.059747:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789127392.059753:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586044f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789491840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.060472:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789491584:0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.060541:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127392.060571:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789492096:0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.060595:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127392.060613:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789492608:0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.060650:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127392.060668:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789493120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127392.060687:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127392.060700:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789127392.060706:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789491968:0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.060725:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127392.060740:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789492480:0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.061424:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127392.061454:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789492992:0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.061481:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127392.061546:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789492096 00000100:00100000:0.0:1789127392.061552:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789492096 00000100:00100000:0.0:1789127392.062719:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789493120 00000100:00100000:0.0:1789127392.062726:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789493120 00000100:00100000:0.0:1789127392.062750:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789127392.063231:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586044f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789491840:12345-0@lo:400:kworker.0 Request processed in 3476us (4036us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127392.063239:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789127392.063270:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789127392.063278:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789493120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127392.063301:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789127392.063351:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789493120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (2662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127392.063357:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789127392.063383:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789491584 00000100:00100000:1.0:1789127392.063387:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789491584 00000100:00100000:1.0:1789127392.063413:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1789127392.063419:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789491584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127392.063460:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789491584:12345-0@lo:400:kworker.0 Request processed in 41us (2919us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127392.063466:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1789127392.064022:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789492096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.064067:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789492096:12345-0@lo:400:kworker.0 Request processed in 1307us (3468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127392.064072:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789127392.064097:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789492608 00000100:00100000:0.0:1789127392.064101:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789492608 00000100:00100000:0.0:1789127392.064128:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789492480 00000100:00100000:0.0:1789127392.064130:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789492480 00000100:00100000:0.0:1789127392.064144:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789492992 00000100:00100000:0.0:1789127392.064146:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789492992 00000100:00100000:0.0:1789127392.064159:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789127392.064165:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789492608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.064195:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789492608:12345-0@lo:400:kworker.0 Request processed in 31us (3544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127392.064201:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789127392.064211:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789127392.064216:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789492480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.064240:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789492480:12345-0@lo:400:kworker.0 Request processed in 24us (2819us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127392.064245:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789127392.064255:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789127392.064260:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789492992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.064285:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789492992:12345-0@lo:400:kworker.0 Request processed in 26us (2804us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127392.064300:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1789127392.064324:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127392.064328:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127392.064330:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127392.064332:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127392.064362:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127392.064375:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789493248:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127392.064410:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127392.064459:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789491840:0@lo:400:kworker.0 00010000:00080000:0.0:1789127392.064474:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587f09680 x1876035789492352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127392.064484:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f09680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789492352:0@lo:400:kworker.0 00010000:00080000:0.0:1789127392.064494:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587f0bc00 x1876035789492864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127392.064502:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f0bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789492864:0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.064550:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789491712:0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.064562:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f09a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789492224:0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.064572:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f0a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789492736:0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.064614:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789491968 00000100:00100000:0.0:1789127392.064619:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789491968 00000100:00100000:0.0:1789127392.064656:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789127392.064662:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789491968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127392.064692:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789491968:12345-0@lo:400:kworker.0 Request processed in 31us (3966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127392.064703:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1789127392.064728:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789493248 00000100:00100000:0.0:1789127392.064731:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789493248 00000100:00100000:0.0:1789127392.064752:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789127392.067168:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b083c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789491968:0@lo:400:kworker.0 00010000:00080000:2.0:1789127392.067190:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587f09e00 x1876035789492480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127392.067201:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f09e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789492480:0@lo:400:kworker.0 00010000:00080000:2.0:1789127392.067212:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587f0b480 x1876035789492992/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127392.067220:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789492992:0@lo:400:kworker.0 00000100:00100000:2.0:1789127392.067230:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789491584:0@lo:400:kworker.0 00000100:00100000:2.0:1789127392.067240:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789492096:0@lo:400:kworker.0 00010000:00080000:2.0:1789127392.067250:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587f0b840 x1876035789492608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127392.067275:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f0b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789492608:0@lo:400:kworker.0 00000100:00100000:2.0:1789127392.067295:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587f092c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789493120:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127392.068530:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789493248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789127392.068559:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127392.068650:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789493248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3890us (4238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127392.068659:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1789127392.068878:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aeca43c0 x1876035789493248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127392.068895:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789493248:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1789127392.120090:0:13393:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789127392.186308:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127392.568080:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789493376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127392.568149:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127392.569140:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789493376 00000100:00100000:3.0:1789127392.569150:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789493376 00000100:00100000:3.0:1789127392.569218:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789127392.569228:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789493376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127392.569257:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127392.569315:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789493376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127392.569322:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:3.0:1789127392.569363:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b738a580 x1876035789493376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127392.569381:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789493376:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127392.569679:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789493504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127392.569714:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127392.569852:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789493504 00000100:00100000:1.0:1789127392.569857:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789493504 00000100:00100000:1.0:1789127392.569895:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789127392.569903:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789493504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127392.569916:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127392.569949:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789493504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127392.569955:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1789127392.573592:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934586044000 x1876035789493504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127392.573616:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789493504:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789127393.207774:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127394.231781:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127394.812823:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127394.812863:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127394.812890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127394.812913:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127394.812942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127394.812967:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771583872 00000100:00100000:2.0:1789127394.812975:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771583872 00000100:00100000:2.0:1789127394.813015:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771584000 00000100:00100000:2.0:1789127394.813017:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771584000 00000100:00100000:2.0:1789127394.813026:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771584256 00000100:00100000:2.0:1789127394.813028:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771584256 00000100:00100000:2.0:1789127394.813037:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771584128 00000100:00100000:2.0:1789127394.813039:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771584128 00000100:00100000:2.0:1789127394.813052:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 198 00000100:00100000:2.0:1789127394.813060:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771583872:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127394.813119:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771583872:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 59us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127394.813139:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 198 00000100:00100000:2.0:1789127394.813154:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 199 00000100:00100000:2.0:1789127394.813159:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771584000:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127394.813191:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771584000:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 31us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127394.813197:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 199 00000100:00100000:2.0:1789127394.813206:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 200 00000100:00100000:2.0:1789127394.813212:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771584256:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127394.813232:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771584256:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 20us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127394.813238:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 200 00000100:00100000:2.0:1789127394.813249:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 201 00000100:00100000:2.0:1789127394.813255:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771584128:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127394.813275:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771584128:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 21us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127394.813280:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 201 00000100:00100000:0.0:1789127394.813444:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771583744 00000100:00100000:0.0:1789127394.813449:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771583744 00000100:00100000:0.0:1789127394.813486:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 334 00000100:00100000:0.0:1789127394.813493:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2402:x1876035771583744:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127394.813558:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2402:x1876035771583744:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 65us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127394.813564:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 334 00000100:00080000:0.0:1789127394.813591:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127394.813595:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789127395.266769:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127396.279698:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127396.664373:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789493632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127396.664445:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127396.666105:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789493632 00000100:00100000:3.0:1789127396.666231:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789493632 00000100:00100000:3.0:1789127396.666665:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789127396.666676:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b738a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789493632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127396.666717:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789127396.666972:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b738a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789493632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 297us (2525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127396.666981:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789127396.667158:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789493632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127397.175852:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789493760:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.175921:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.175986:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789493760 00000100:00100000:0.0:1789127397.175993:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789493760 00000100:00100000:0.0:1789127397.176035:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789127397.176044:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789493760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.176093:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789493760:12345-0@lo:400:kworker.0 Request processed in 50us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.176101:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1789127397.176146:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789493760:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.176998:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789493888:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177038:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.177070:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789494400:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177091:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.177107:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789494912:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177126:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.177147:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789127397.177153:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789494272:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177176:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.177192:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789494784:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177214:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.177228:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789495296:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177267:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.177291:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789494016:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177313:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.177346:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789494528:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177366:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.177382:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789495040:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177402:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.177413:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789127397.177418:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789494144:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177436:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.177446:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789494656:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177464:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.177479:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789495168:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177538:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.177567:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789493888 00000100:00100000:0.0:1789127397.177574:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789493888 00000100:00100000:0.0:1789127397.177604:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789494400 00000100:00100000:0.0:1789127397.177606:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789494400 00000100:00100000:0.0:1789127397.177627:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789494912 00000100:00100000:0.0:1789127397.177630:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789494912 00000100:00100000:0.0:1789127397.177642:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789494528 00000100:00100000:0.0:1789127397.177644:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789494528 00000100:00100000:0.0:1789127397.177655:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789495040 00000100:00100000:0.0:1789127397.177656:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789495040 00000100:00100000:0.0:1789127397.177665:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789494144 00000100:00100000:0.0:1789127397.177667:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789494144 00000100:00100000:0.0:1789127397.177680:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789127397.177687:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789493888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177737:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789493888:12345-0@lo:400:kworker.0 Request processed in 50us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.177744:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789127397.177773:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789127397.177779:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789494400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177806:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789494400:12345-0@lo:400:kworker.0 Request processed in 28us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.177812:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789127397.177823:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789127397.177828:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789494912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177852:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789494912:12345-0@lo:400:kworker.0 Request processed in 24us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.177857:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789127397.177868:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789127397.177873:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789494528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177901:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f0a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789494528:12345-0@lo:400:kworker.0 Request processed in 28us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.177907:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789127397.177917:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789127397.177923:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789495040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177945:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f09a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789495040:12345-0@lo:400:kworker.0 Request processed in 23us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.177950:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789127397.177959:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789127397.177965:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789494144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.177994:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789494144:12345-0@lo:400:kworker.0 Request processed in 30us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.178001:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789127397.178019:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789494272 00000100:00100000:0.0:1789127397.178022:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789494272 00000100:00100000:0.0:1789127397.178045:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789494016 00000100:00100000:0.0:1789127397.178048:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789494016 00000100:00100000:0.0:1789127397.178059:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789127397.178064:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789494272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.178095:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f092c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789494272:12345-0@lo:400:kworker.0 Request processed in 30us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.178101:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789127397.178110:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789127397.178115:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789494016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.178138:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789494016:12345-0@lo:400:kworker.0 Request processed in 23us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.178144:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789127397.178159:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789494784 00000100:00100000:0.0:1789127397.178162:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789494784 00000100:00100000:0.0:1789127397.178183:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789495296 00000100:00100000:0.0:1789127397.178186:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789495296 00000100:00100000:0.0:1789127397.178196:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789494656 00000100:00100000:0.0:1789127397.178199:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789494656 00000100:00100000:0.0:1789127397.178208:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789495168 00000100:00100000:0.0:1789127397.178210:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789495168 00000100:00100000:0.0:1789127397.178220:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789127397.178226:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789494784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.178255:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f0b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789494784:12345-0@lo:400:kworker.0 Request processed in 29us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.178267:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789127397.178278:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789127397.178283:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789495296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.178310:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789495296:12345-0@lo:400:kworker.0 Request processed in 27us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.178316:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789127397.178325:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789127397.178331:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789494656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.178352:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789494656:12345-0@lo:400:kworker.0 Request processed in 22us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.178358:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789127397.178367:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789127397.178372:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789495168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.178395:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b09e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789495168:12345-0@lo:400:kworker.0 Request processed in 23us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.178401:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1789127397.178429:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127397.178433:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127397.178436:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127397.178438:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127397.178472:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789494144:0@lo:400:kworker.0 00010000:00080000:0.0:1789127397.178484:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ee4780 x1876035789494656/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127397.178506:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789494656:0@lo:400:kworker.0 00010000:00080000:0.0:1789127397.178539:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ee6580 x1876035789495168/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127397.178555:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789495168:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.178566:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789494016:0@lo:400:kworker.0 00010000:00080000:0.0:1789127397.178576:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ee7840 x1876035789494528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127397.178584:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789494528:0@lo:400:kworker.0 00010000:00080000:0.0:1789127397.178594:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ee4b40 x1876035789495040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127397.178601:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789495040:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.178638:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789494272:0@lo:400:kworker.0 00010000:00080000:0.0:1789127397.178649:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ee4000 x1876035789494784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127397.178657:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789494784:0@lo:400:kworker.0 00010000:00080000:0.0:1789127397.178666:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ee7c00 x1876035789495296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127397.178674:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789495296:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.178683:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789493888:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.178692:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789494400:0@lo:400:kworker.0 00000100:00100000:0.0:1789127397.178702:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789494912:0@lo:400:kworker.0 00000100:00100000:1.0:1789127397.180885:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127397.180904:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789495552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127397.180958:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127397.180996:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789495552 00000100:00100000:1.0:1789127397.181002:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789495552 00000100:00100000:1.0:1789127397.183911:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789127397.183931:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789495552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789127397.183962:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127397.184034:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789495552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (3075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127397.184043:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1789127397.184440:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ee5680 x1876035789495552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127397.184471:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789495552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127397.184720:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127397.184732:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789495424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127397.184841:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789495680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127397.184880:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.184918:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789495680 00000100:00100000:0.0:1789127397.184923:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789495680 00000100:00100000:0.0:1789127397.184959:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789127397.184967:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789495680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789127397.184991:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127397.185026:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789495680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.185033:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789127397.185065:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789495680:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127397.185119:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127397.185184:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789495424 00000100:00100000:0.0:1789127397.185188:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789495424 00000100:00100000:0.0:1789127397.185217:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789127397.185224:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789495424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127397.185237:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127397.185268:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789495424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127397.185275:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:2.0:1789127397.185433:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93458840da40 x1876035789495424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127397.185448:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789495424:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789127397.306026:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127397.687697:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7388780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789495808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127397.687763:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127397.687820:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789495808 00000100:00100000:2.0:1789127397.687842:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789495808 00000100:00100000:2.0:1789127397.687893:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789127397.687903:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789495808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789127397.687932:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127397.695200:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789495808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 7289us (7426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127397.695216:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1789127397.702003:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7388780 x1876035789495808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127397.702124:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7388780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789495808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127397.702151:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127397.702162:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789495936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127397.702224:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127397.702281:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789495936 00000100:00100000:2.0:1789127397.702288:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789495936 00000100:00100000:2.0:1789127397.702333:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789127397.702342:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789495936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127397.702363:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127397.702410:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b083c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789495936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127397.702417:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1789127397.702453:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878ce1c0 x1876035789495936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127397.702466:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789495936:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1789127398.202916:0:13687:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff20bad2b0 20000000:00000080:1.0:1789127398.202932:0:13687:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9346b731cc00 uarg=0000000000000000 20000000:01000000:1.0:1789127398.202977:0:13687:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:1.0:1789127398.202982:0:13687:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:1.0:1789127398.202987:0:13687:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:3.0:1789127398.208373:0:13688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789127398.208867:0:13687:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:0.0:1789127398.217960:0:13687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789127398.217990:0:13687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:0.0:1789127398.218003:0:13687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:0.0:1789127398.218097:0:13687:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789127398.218116:0:13687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.218133:0:13687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928fe800/0xd718aadfd785d67e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb70 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.218142:0:13687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93458858c400/0xd718aadfd785d685 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb77 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.218150:0:13687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff934587fed800/0xd718aadfd785d693 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d68c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.218156:0:13687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff934587fec400/0xd718aadfd785d6a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d69a expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.218162:0:13687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6af lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d6a8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.218167:0:13687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93458858da00/0xd718aadfd785d6bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d6b6 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.218191:0:13687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.218225:0:13687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93458858da00/0xd718aadfd785d6bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d6b6 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.218237:0:13687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93458858da00/0xd718aadfd785d6bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d6b6 expref: 23 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127398.218249:0:13687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13687:1876035789496064:0@lo:104: 00000100:00100000:0.0:1789127398.218387:0:13687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127398.218441:0:13687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d6a8 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.218448:0:13687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d6a8 expref: 23 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127398.218457:0:13687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587b0bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13687:1876035789496192:0@lo:104: 00010000:00010000:0.0:1789127398.218483:0:13687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff934587fec400/0xd718aadfd785d6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d69a expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.218503:0:13687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff934587fec400/0xd718aadfd785d6a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d69a expref: 23 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127398.218626:0:13687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7388780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13687:1876035789496320:0@lo:104: 00010000:00010000:0.0:1789127398.218658:0:13687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff934587fed800/0xd718aadfd785d693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d68c expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.218665:0:13687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff934587fed800/0xd718aadfd785d693 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d68c expref: 23 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127398.218682:0:13687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345860443c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13687:1876035789496448:0@lo:104: 00010000:00010000:0.0:1789127398.218709:0:13687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93458858c400/0xd718aadfd785d685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb77 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.218719:0:13687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93458858c400/0xd718aadfd785d685 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb77 expref: 12 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127398.218728:0:13687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586044000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13687:1876035789496576:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127398.218820:0:13687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928fe800/0xd718aadfd785d67e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb70 expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.218829:0:13687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9346928fe800/0xd718aadfd785d67e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb70 expref: 12 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127398.218836:0:13687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13687:1876035789496704:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127398.218858:0:9528:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789127398.218863:0:13687:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346c1acce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127398.218876:0:9528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127398.218894:0:9528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127398.218899:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789496064 00000100:00100000:2.0:1789127398.218906:0:9528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127398.218906:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789496064 00000100:00100000:2.0:1789127398.218916:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789496192 00000100:00100000:2.0:1789127398.218919:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789496192 00000100:00100000:0.0:1789127398.218950:0:6506:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789496320 00000100:00100000:0.0:1789127398.218953:0:6506:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789496320 00000100:00100000:3.0:1789127398.219226:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789496448 00000100:00100000:3.0:1789127398.219230:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789496448 00000100:00100000:1.0:1789127398.219567:0:10403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789127398.219577:0:10403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e92450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:13687:x1876035789496064:12345-0@lo:104: 00010000:00010000:1.0:1789127398.219591:0:10403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d6bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127398.219646:0:10403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127398.219653:0:10403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e92450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:13687:x1876035789496064:12345-0@lo:104: Request processed in 78us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127398.219660:0:10403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789127398.222891:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789127398.222979:0:6506:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789127398.222998:0:6506:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:13687:x1876035789496192:12345-0@lo:104: 00000100:00100000:3.0:1789127398.223002:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789127398.223010:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:13687:x1876035789496448:12345-0@lo:104: 00010000:00010000:0.0:1789127398.223030:0:6506:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d6af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127398.223034:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:13687:x1876035789496320:12345-0@lo:104: 00010000:00010000:0.0:1789127398.223117:0:6506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789127398.223123:0:6506:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+6:13687:x1876035789496192:12345-0@lo:104: Request processed in 137us (4246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127398.223142:0:6506:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789127398.223197:0:13687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13687:1876035789496064:0@lo:104: 00000100:00100000:0.0:1789127398.223208:0:13687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587b0bc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13687:1876035789496192:0@lo:104: 00010000:00010000:0.0:1789127398.223241:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127398.223247:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d6bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127398.223419:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127398.223426:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d6af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127398.223452:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d693 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127398.223530:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127398.223535:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:13687:x1876035789496448:12345-0@lo:104: Request processed in 528us (4628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127398.223542:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1789127398.227277:0:9528:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d6a1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.227291:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d800 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127398.227301:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d6bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.227317:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d6bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127398.227325:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d6bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127398.227331:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127398.227388:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.227394:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127398.227417:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.227424:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93458858d800/0xd718aadfd785d6b6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6bd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.227441:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127398.227456:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d693 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.227462:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff000 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127398.227465:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d693 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.227472:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d693 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127398.227478:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d693 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127398.227482:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127398.227526:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d693 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.227532:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127398.227539:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d693 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.227545:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928ff000/0xd718aadfd785d68c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d693 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.227556:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127398.227558:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127398.227559:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127398.227591:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789496960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127398.227638:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127398.227654:0:9528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789127398.227660:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:13687:x1876035789496320:12345-0@lo:104: Request processed in 4704us (8765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127398.227669:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789127398.227675:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789127398.227680:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789496832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127398.227708:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127398.227755:0:13687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7388780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13687:1876035789496320:0@lo:104: 00000100:00100000:0.0:1789127398.227766:0:13687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345860443c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13687:1876035789496448:0@lo:104: 00000100:00100000:0.0:1789127398.227812:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789496960 00000100:00100000:0.0:1789127398.227818:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789496960 00010000:00010000:0.0:1789127398.227843:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff934587fed800/0xd718aadfd785d693 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d68c expref: 24 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127398.227865:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789496832 00000100:00100000:0.0:1789127398.227867:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789496832 00010000:00010000:0.0:1789127398.227880:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93458858da00/0xd718aadfd785d6bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d6b6 expref: 25 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127398.227897:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789127398.227904:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+25:3653:x1876035789496960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127398.227915:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127398.227919:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff934587fed800/0xd718aadfd785d693 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d68c expref: 25 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.227928:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff934587fed800/0xd718aadfd785d693 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d68c expref: 25 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.227941:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587fed800/0xd718aadfd785d693 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d68c expref: 25 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.227952:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127398.227980:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789496960:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127398.227987:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789127398.228006:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789127398.228012:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:3653:x1876035789496832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127398.228231:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127398.228236:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93458858da00/0xd718aadfd785d6bd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d6b6 expref: 23 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.228246:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93458858da00/0xd718aadfd785d6bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d6b6 expref: 23 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.228255:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93458858da00/0xd718aadfd785d6bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d6b6 expref: 23 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.228264:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127398.228287:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:3653:x1876035789496832:12345-0@lo:103:ldlm_bl.0 Request processed in 275us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127398.228293:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789127398.228321:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789496832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127398.228330:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789496960:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127398.228348:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127398.228353:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d6a1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.228359:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe200 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127398.228363:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d6a1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.228370:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d6a1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127398.228387:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d6a1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127398.228392:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127398.228414:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6a1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.228420:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127398.228435:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6a1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.228442:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928fe200/0xd718aadfd785d69a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6a1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.228451:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127398.228452:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127398.228454:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127398.228602:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127398.228620:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771584384 00000100:00100000:0.0:1789127398.228624:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771584384 00010000:00010000:0.0:1789127398.228638:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928fe800/0xd718aadfd785d67e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb70 expref: 13 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127398.228656:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:0.0:1789127398.228662:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771584384:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127398.228669:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127398.228672:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928fe800/0xd718aadfd785d67e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb70 expref: 13 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.228690:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928fe800/0xd718aadfd785d67e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb70 expref: 13 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.228701:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127398.228734:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771584384:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 71us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127398.228740:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00010000:00010000:0.0:1789127398.228756:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127398.228842:0:13687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586044000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13687:1876035789496576:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127398.228851:0:13687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928fe800/0xd718aadfd785d67e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb70 expref: 12 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127398.228859:0:13687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13687:1876035789496704:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127398.228889:0:13687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127398.228918:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789497088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127398.228945:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127398.228978:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789497088 00000100:00100000:0.0:1789127398.228982:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789497088 00010000:00010000:0.0:1789127398.228995:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff934587fec400/0xd718aadfd785d6a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d69a expref: 22 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127398.229460:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789127398.229470:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:3650:x1876035789497088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127398.229587:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127398.229600:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff934587fec400/0xd718aadfd785d6a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d69a expref: 22 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.229609:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff934587fec400/0xd718aadfd785d6a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d69a expref: 22 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.229623:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587fec400/0xd718aadfd785d6a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d69a expref: 22 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.229633:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127398.229667:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3650:x1876035789497088:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127398.229673:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1789127398.229762:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fedc00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127398.229768:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d6af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127398.229777:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d6af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127398.229783:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d6af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127398.229788:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127398.229854:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127398.229867:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127398.229882:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127398.229889:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934587fedc00/0xd718aadfd785d6a8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6af expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127398.229910:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789497216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127398.229939:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127398.229984:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789497216 00000100:00100000:1.0:1789127398.229989:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789497216 00010000:00010000:1.0:1789127398.230006:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d6a8 expref: 21 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127398.230103:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789497088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127398.230178:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789127398.230186:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3651:x1876035789497216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127398.230194:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127398.230199:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6af lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d6a8 expref: 21 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127398.230209:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6af lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d6a8 expref: 21 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127398.230220:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6af lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d6a8 expref: 21 pid: 6514 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127398.230229:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127398.230264:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee7840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:3651:x1876035789497216:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127398.230276:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1789127398.230294:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127398.230296:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127398.230298:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127398.230475:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789497216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127398.234915:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127398.235220:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771584512 00000100:00100000:0.0:1789127398.235230:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771584512 00010000:00010000:0.0:1789127398.235265:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93458858c400/0xd718aadfd785d685 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb77 expref: 12 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127398.235310:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:0.0:1789127398.235321:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:2402:x1876035771584512:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127398.235335:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127398.235341:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93458858c400/0xd718aadfd785d685 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb77 expref: 12 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.235354:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93458858c400/0xd718aadfd785d685 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb77 expref: 12 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.235373:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93458858c400/0xd718aadfd785d685 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb77 expref: 12 pid: 6516 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.235408:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.235416:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.235433:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.235440:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.235447:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.235454:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.235460:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587feca00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127398.235464:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.235472:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.235506:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127398.235567:0:13687:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127398.235576:0:13687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.237923:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587feca00/0xd718aadfd785d6c4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127398.237966:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127398.238038:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee6580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:2402:x1876035771584512:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 2716us (3129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127398.238049:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00010000:00010000:3.0:1789127398.331711:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127399.351819:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789127399.864357:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789127399.864365:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934586ebc000 from 7 10000000:01000000:0.0:1789127399.864369:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127399.864412:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127399.864424:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127399.864434:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127399.864458:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789497344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127399.864560:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127399.864637:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346c1acce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127399.864780:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789497344 00000100:00100000:2.0:1789127399.864788:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789497344 00000100:00100000:2.0:1789127399.864850:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789127399.864861:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789497344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127399.864873:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127399.864886:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d6cb expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127399.864907:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d6cb expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127399.864917:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d6cb expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127399.864926:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff600, rc 0) 00000100:00100000:2.0:1789127399.864977:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789497344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127399.864983:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1789127399.865332:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789497344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127399.865356:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6d2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127399.865365:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d6d2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127399.865427:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789497472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127399.865458:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127399.865493:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d2a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127399.865600:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789497472 00000100:00100000:2.0:1789127399.865605:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789497472 00000100:00100000:2.0:1789127399.865650:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1789127399.865667:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789497472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127399.865934:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789497472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 275us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127399.865941:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1789127399.866022:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789497472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127399.866052:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789497600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127399.866095:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127399.866124:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d2a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127399.866293:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789497600 00000100:00100000:2.0:1789127399.866297:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789497600 00000100:00100000:2.0:1789127399.866330:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1789127399.866337:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789497600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127399.866414:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789497600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127399.866420:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:1.0:1789127399.866497:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789497600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127399.867020:0:13748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13748:1876035789497728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127399.867057:0:13748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127399.867086:0:13748:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d2a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789127399.867247:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789497728 00000100:00100000:2.0:1789127399.867252:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789497728 00000100:00100000:2.0:1789127399.867284:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1789127399.867291:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:13748:x1876035789497728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127399.867374:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:13748:x1876035789497728:12345-0@lo:502:llog_process_th.0 Request processed in 82us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127399.867380:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789127399.867456:0:13748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13748:1876035789497728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127399.867492:0:13748:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127399.867502:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127399.867505:0:13748:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789127399.867539:0:13748:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff934586ebc000 00000020:00000080:3.0:1789127399.867543:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789127399.867620:0:13748:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13748:1876035789497856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127399.867655:0:13748:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127399.867687:0:13748:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dd2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789127399.867758:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789497856 00000100:00100000:0.0:1789127399.867763:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789497856 00000100:00100000:0.0:1789127399.867796:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789127399.867803:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:13748:x1876035789497856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127399.867887:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:13748:x1876035789497856:12345-0@lo:502:llog_process_th.0 Request processed in 84us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127399.867894:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:1.0:1789127399.868294:0:13748:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13748:1876035789497856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127399.868325:0:13748:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127399.868330:0:13748:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127399.868332:0:13748:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:1.0:1789127399.868335:0:13748:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789127399.868428:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789127399.868452:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127399.868461:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6d2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127399.868471:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6d2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127399.868492:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789127399.868495:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b6688800 from 7 10000000:01000000:0.0:1789127399.868497:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127399.868542:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127399.868550:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127399.868559:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127399.868574:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789497984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127399.868610:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127399.868838:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698880c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127399.870371:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127399.881037:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789497984 00000100:00100000:1.0:1789127399.881217:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789497984 00000100:00100000:1.0:1789127399.881283:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771584640 00000100:00100000:1.0:1789127399.881288:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771584640 00000100:00100000:1.0:1789127399.881308:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789127399.881318:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789497984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127399.881334:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127399.881352:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93458858c600/0xd718aadfd785d6e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d6d9 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127399.881380:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93458858c600/0xd718aadfd785d6e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d6d9 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127399.881392:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93458858c600/0xd718aadfd785d6e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d6d9 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127399.881402:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c600, rc 0) 00000100:00100000:1.0:1789127399.881472:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789497984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (12861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127399.881494:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789127399.881549:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 342 00000100:00100000:1.0:1789127399.881556:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:6173:x1876035771584640:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127399.881563:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127399.881571:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93458858c200/0xd718aadfd785d6e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffb7e expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127399.881595:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93458858c200/0xd718aadfd785d6e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb7e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127399.881604:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93458858c200/0xd718aadfd785d6e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb7e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127399.881611:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c200, rc 0) 00000100:00100000:0.0:1789127399.881879:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789497984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127399.881896:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6e0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127399.881905:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d6e0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127399.881986:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789498112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127399.882044:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771584640:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 487us (11677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127399.882067:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 342 00000100:00100000:0.0:1789127399.891261:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127399.891544:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698880c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127399.899229:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789498112 00000100:00100000:0.0:1789127399.899243:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789498112 00000100:00100000:0.0:1789127399.899308:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789127399.899319:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789498112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127399.899496:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789498112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 178us (8449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127399.899504:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1789127399.899594:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789498112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127399.899644:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789498240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127399.899688:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127399.899726:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127399.899810:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789498240 00000100:00100000:1.0:1789127399.899816:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789498240 00000100:00100000:1.0:1789127399.899852:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1789127399.899859:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789498240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127399.899936:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789498240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127399.899944:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789127399.901125:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127399.901556:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771584768 00000100:00100000:0.0:1789127399.901564:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771584768 00000100:00100000:0.0:1789127399.901618:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 345 00000100:00100000:0.0:1789127399.901627:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771584768:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127399.901756:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771584768:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 128us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127399.901764:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 345 00000100:00100000:0.0:1789127399.901911:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789498240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127399.902094:0:13751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13751:1876035789498368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127399.902184:0:13751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127399.902217:0:13751:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127399.902287:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789498368 00000100:00100000:0.0:1789127399.902293:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789498368 00000100:00100000:0.0:1789127399.902330:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1789127399.902338:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:13751:x1876035789498368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127399.902667:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:13751:x1876035789498368:12345-0@lo:502:llog_process_th.0 Request processed in 329us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127399.902674:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789127399.902774:0:13751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13751:1876035789498368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127399.902797:0:13751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127399.902807:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127399.902809:0:13751:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789127399.902818:0:13751:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b6688800 00000020:00000080:2.0:1789127399.902820:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789127399.902897:0:13751:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13751:1876035789498496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127399.902934:0:13751:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127399.902957:0:13751:0:(client.c:2715:ptlrpc_set_wait()) set ffff934587e57180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127399.903949:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127399.904499:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789498496 00000100:00100000:2.0:1789127399.904523:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789498496 00000100:00100000:2.0:1789127399.904814:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771584896 00000100:00100000:2.0:1789127399.904819:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771584896 00000100:00100000:1.0:1789127399.908749:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789127399.908770:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:13751:x1876035789498496:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127399.908922:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:13751:x1876035789498496:12345-0@lo:502:llog_process_th.0 Request processed in 160us (5986us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127399.908930:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789127399.908974:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 348 00000100:00100000:1.0:1789127399.908982:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771584896:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127399.909069:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771584896:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 86us (5125us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127399.909076:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 348 00000100:00100000:2.0:1789127399.910028:0:13751:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13751:1876035789498496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127399.910065:0:13751:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127399.910073:0:13751:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127399.910075:0:13751:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789127399.910082:0:13751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789127399.910371:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789127399.910451:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127399.910463:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6e0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127399.910473:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6e0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127399.910660:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789127399.910664:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b640b000 from 7 10000000:01000000:3.0:1789127399.910667:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127399.910700:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127399.910710:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127399.910720:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127399.910741:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789498624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127399.910805:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127399.910849:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dd2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127399.910964:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789498624 00000100:00100000:2.0:1789127399.910976:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789498624 00000100:00100000:2.0:1789127399.911021:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:2.0:1789127399.911029:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789498624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127399.911039:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127399.911050:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928fe800/0xd718aadfd785d6f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d6ee expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127399.911073:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928fe800/0xd718aadfd785d6f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d6ee expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127399.911100:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928fe800/0xd718aadfd785d6f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d6ee expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127399.911108:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe800, rc 0) 00000100:00100000:2.0:1789127399.911162:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789498624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127399.911170:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789127399.911191:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789498624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127399.911207:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127399.911218:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d6f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127399.911275:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789498752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127399.911303:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127399.911328:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dd2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127399.914294:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789498752 00000100:00100000:2.0:1789127399.914308:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789498752 00000100:00100000:2.0:1789127399.914369:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789127399.914389:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789498752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127399.914556:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789498752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (3250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127399.914564:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1789127399.914626:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789498752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127399.914672:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789498880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127399.914717:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127399.914755:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934587e57480 going to sleep for 11 seconds 00000100:00100000:2.0:1789127399.914768:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789498880 00000100:00100000:2.0:1789127399.914772:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789498880 00000100:00100000:2.0:1789127399.914795:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789127399.914801:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789498880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127399.914875:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789498880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127399.914881:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789127399.914929:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789498880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127399.918943:0:13753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13753:1876035789499008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127399.919027:0:13753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127399.919074:0:13753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127399.919142:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789499008 00000100:00100000:3.0:1789127399.919155:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789499008 00000100:00100000:3.0:1789127399.919199:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789127399.919207:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:13753:x1876035789499008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127399.919376:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:13753:x1876035789499008:12345-0@lo:502:llog_process_th.0 Request processed in 168us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127399.919384:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1789127399.920086:0:13753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13753:1876035789499008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127399.920195:0:13753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127399.920206:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127399.920208:0:13753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127399.920215:0:13753:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b640b000 00000020:00000080:0.0:1789127399.920218:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789127399.920894:0:13753:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13753:1876035789499136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127399.920954:0:13753:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127399.921049:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127399.921082:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771585024 00000100:00100000:3.0:1789127399.921088:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771585024 00000100:00100000:3.0:1789127399.921127:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 353 00000100:00100000:3.0:1789127399.921136:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:10330:x1876035771585024:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789127399.921235:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:10330:x1876035771585024:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 99us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127399.921243:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 353 00000100:00100000:0.0:1789127399.922935:0:13753:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127399.924928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789499136 00000100:00100000:3.0:1789127399.924939:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789499136 00000100:00100000:3.0:1789127399.924985:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1789127399.924994:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:13753:x1876035789499136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127399.925229:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:13753:x1876035789499136:12345-0@lo:502:llog_process_th.0 Request processed in 235us (4275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127399.925238:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789127399.925822:0:13753:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13753:1876035789499136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127399.925855:0:13753:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127399.925862:0:13753:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127399.925865:0:13753:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789127399.925869:0:13753:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789127399.926030:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789127399.926055:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127399.926064:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127399.926075:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d6f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127399.926094:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789127399.926096:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934687bf9800 from 7 10000000:01000000:3.0:1789127399.926099:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127399.926127:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127399.926134:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127399.926143:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127399.926163:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ded2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789499264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127399.926206:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127399.926245:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dd2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127399.926959:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789499264 00000100:00100000:2.0:1789127399.926966:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789499264 00000100:00100000:3.0:1789127399.927103:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1789127399.927114:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789499264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127399.927126:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127399.927140:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d703 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d6fc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127399.927163:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d6fc expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127399.927172:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d6fc expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127399.927180:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a0e00, rc 0) 00000100:00100000:3.0:1789127399.927244:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789499264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127399.927251:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789127399.927431:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ded2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789499264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127399.927446:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d703 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127399.927456:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d703 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127399.927547:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789499392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127399.927575:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127399.927598:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127399.930052:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789499392 00000100:00100000:3.0:1789127399.930066:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789499392 00000100:00100000:3.0:1789127399.930118:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1789127399.930127:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789499392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127399.930276:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789499392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 150us (2700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127399.930284:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1789127399.931306:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789499392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127399.931353:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789499520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127399.931405:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127399.931440:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127399.931454:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789499520 00000100:00100000:0.0:1789127399.931459:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789499520 00000100:00100000:0.0:1789127399.931503:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789127399.931524:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789499520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127399.931608:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789499520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127399.931625:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789127399.931664:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789499520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127399.931826:0:13754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13754:1876035789499648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127399.931859:0:13754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127399.931879:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789499648 00000100:00100000:0.0:1789127399.931883:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789499648 00000100:00100000:0.0:1789127399.931900:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1789127399.931906:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:13754:x1876035789499648:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127399.931970:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:13754:x1876035789499648:12345-0@lo:502:llog_process_th.0 Request processed in 64us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127399.931977:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1789127399.932002:0:13754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127399.932013:0:13754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13754:1876035789499648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127399.932032:0:13754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127399.932041:0:13754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127399.932043:0:13754:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127399.932062:0:13754:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff934687bf9800 00000020:00000080:0.0:1789127399.932064:0:13754:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789127399.932133:0:13754:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13754:1876035789499776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127399.932165:0:13754:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127399.932181:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789499776 00000100:00100000:0.0:1789127399.932184:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789499776 00000100:00100000:0.0:1789127399.932200:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789127399.932205:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:13754:x1876035789499776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127399.932256:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:13754:x1876035789499776:12345-0@lo:502:llog_process_th.0 Request processed in 50us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127399.932267:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789127399.932297:0:13754:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127399.932308:0:13754:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:13754:1876035789499776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127399.932324:0:13754:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127399.932328:0:13754:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127399.932330:0:13754:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789127399.932333:0:13754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:1.0:1789127399.932654:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000020:01000000:2.0:1789127399.932957:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789127399.932982:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127399.932992:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d703 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127399.933003:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d703 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127399.935071:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127399.935105:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127399.935128:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127399.935202:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127399.935204:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771585152 00000100:00100000:0.0:1789127399.935213:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771585152 00000100:00100000:2.0:1789127399.935221:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771585280 00000100:00100000:2.0:1789127399.935224:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771585280 00000100:00100000:2.0:1789127399.935251:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771585536 00000100:00100000:2.0:1789127399.935254:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771585536 00000100:00100000:0.0:1789127399.935254:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 360 00000100:00100000:0.0:1789127399.935262:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:10330:x1876035771585152:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127399.935264:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771585408 00000100:00100000:2.0:1789127399.935266:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771585408 00000100:00100000:2.0:1789127399.935275:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771585664 00000100:00100000:2.0:1789127399.935277:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771585664 00000100:00100000:2.0:1789127399.935289:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 208 00000100:00100000:2.0:1789127399.935295:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2399:x1876035771585280:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127399.935352:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2399:x1876035771585280:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 56us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127399.935355:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:10330:x1876035771585152:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 94us (2704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127399.935359:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 208 00000100:00100000:0.0:1789127399.935361:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 360 00000100:00100000:2.0:1789127399.935373:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 209 00000100:00100000:2.0:1789127399.935385:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771585536:12345-192.168.206.48@tcp:400:kworker.0 00000100:00080000:0.0:1789127399.935385:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127399.935388:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127399.935410:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771585536:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 26us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127399.935417:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 209 00000100:00100000:2.0:1789127399.935428:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 210 00000100:00100000:2.0:1789127399.935434:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771585408:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127399.935456:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771585408:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 23us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127399.935456:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 211 00000100:00100000:2.0:1789127399.935462:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 210 00000100:00100000:1.0:1789127399.935464:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771585664:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127399.935503:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771585664:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 40us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127399.935526:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 211 00000100:00100000:2.0:1789127399.947800:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127399.947884:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771585792 00000100:00100000:0.0:1789127399.947893:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771585792 00000100:00100000:0.0:1789127399.947945:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 361 00000100:00100000:0.0:1789127399.947954:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771585792:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127399.947970:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127399.947985:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fec200/0xd718aadfd785d70a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffb85 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127399.948012:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fec200/0xd718aadfd785d70a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb85 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127399.948035:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fec200/0xd718aadfd785d70a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb85 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127399.948052:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec200, rc 0) 00000100:00100000:0.0:1789127399.948102:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771585792:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 149us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127399.948110:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 361 00000100:00100000:2.0:1789127399.956210:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127399.956289:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771585920 00000100:00100000:1.0:1789127399.956298:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771585920 00000100:00100000:1.0:1789127399.956347:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 362 00000100:00100000:1.0:1789127399.956355:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771585920:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127399.956472:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771585920:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 117us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127399.956497:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 362 00000100:00100000:0.0:1789127399.963419:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127399.964199:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771586048 00000100:00100000:2.0:1789127399.964209:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771586048 00000100:00100000:2.0:1789127399.964267:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 363 00000100:00100000:2.0:1789127399.964277:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771586048:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127399.964410:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771586048:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 134us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127399.964418:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 363 00000100:00100000:2.0:1789127399.973323:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127399.973702:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771586176 00000100:00100000:0.0:1789127399.973712:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771586176 00000100:00100000:0.0:1789127399.973772:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 364 00000100:00100000:0.0:1789127399.973782:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:10333:x1876035771586176:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127399.973923:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:10333:x1876035771586176:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 142us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127399.973931:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 364 00000100:00100000:3.0:1789127399.978783:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127399.978914:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771586304 00000100:00100000:0.0:1789127399.978924:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771586304 00000100:00100000:0.0:1789127399.978979:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 365 00000100:00100000:0.0:1789127399.978990:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:10333:x1876035771586304:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127399.979143:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:10333:x1876035771586304:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 155us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127399.979153:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 365 00010000:00010000:1.0:1789127400.381533:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127401.399713:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127401.786799:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789499904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127401.786873:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127401.791996:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789499904 00000100:00100000:1.0:1789127401.792010:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789499904 00000100:00100000:1.0:1789127401.792081:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789127401.792091:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789499904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127401.792128:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789127401.794993:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789499904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2895us (8111us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127401.795008:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789127401.796237:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789499904:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127402.296266:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127402.296291:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789500032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127402.296361:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127402.296678:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789500160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127402.296712:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127402.296756:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789500160 00000100:00100000:2.0:1789127402.296762:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789500160 00000100:00100000:2.0:1789127402.296809:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789127402.296818:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789500160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127402.296870:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127402.296912:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789500160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 95us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127402.296920:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:2.0:1789127402.296956:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ee5a40 x1876035789500160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127402.296972:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789500160:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127402.297072:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789500288:0@lo:400:kworker.0 00000100:00100000:2.0:1789127402.297104:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127402.297125:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789500800:0@lo:400:kworker.0 00000100:00100000:2.0:1789127402.297148:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127402.297165:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789501312:0@lo:400:kworker.0 00000100:00100000:2.0:1789127402.297184:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127402.297202:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789127402.297207:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789500672:0@lo:400:kworker.0 00000100:00100000:2.0:1789127402.297226:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127402.297243:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789501184:0@lo:400:kworker.0 00000100:00100000:2.0:1789127402.297264:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127402.297286:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789500288 00000100:00100000:2.0:1789127402.297290:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789500288 00000100:00100000:2.0:1789127402.297313:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1789127402.297320:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789500288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127402.297369:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789500288:12345-0@lo:400:kworker.0 Request processed in 50us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127402.297386:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1789127402.297714:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789500032 00000100:00100000:0.0:1789127402.297719:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789500032 00000100:00100000:0.0:1789127402.297760:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789127402.297769:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789500032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789127402.297792:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127402.297826:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789500032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127402.297832:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1789127402.297863:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127402.297873:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789501184 00000100:00100000:0.0:1789127402.297876:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789501184 00000100:00100000:0.0:1789127402.297904:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789127402.297910:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789501184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127402.297941:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789501184:12345-0@lo:400:kworker.0 Request processed in 32us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127402.297947:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789127402.297965:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127402.298178:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789500544:0@lo:400:kworker.0 00000100:00100000:3.0:1789127402.298212:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127402.298239:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789501056:0@lo:400:kworker.0 00000100:00100000:3.0:1789127402.298266:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127402.298284:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789501568:0@lo:400:kworker.0 00000100:00100000:3.0:1789127402.298304:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127402.298325:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789127402.298331:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789500416:0@lo:400:kworker.0 00000100:00100000:3.0:1789127402.298354:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127402.298371:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789500928:0@lo:400:kworker.0 00000100:00100000:3.0:1789127402.298391:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127402.298402:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789501440:0@lo:400:kworker.0 00000100:00100000:3.0:1789127402.298435:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127402.298484:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789501056 00000100:00100000:3.0:1789127402.298488:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789501056 00000100:00100000:3.0:1789127402.298542:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789501568 00000100:00100000:3.0:1789127402.298545:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789501568 00000100:00100000:3.0:1789127402.298565:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789127402.298572:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789501056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127402.298606:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789501056:12345-0@lo:400:kworker.0 Request processed in 34us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127402.298612:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789127402.298624:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789127402.298630:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789501568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127402.298655:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789501568:12345-0@lo:400:kworker.0 Request processed in 26us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127402.298661:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789127402.298729:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789500544 00000100:00100000:1.0:1789127402.298733:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789500544 00000100:00100000:1.0:1789127402.298762:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789127402.298768:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789500544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127402.298804:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ded2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789500544:12345-0@lo:400:kworker.0 Request processed in 36us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127402.298810:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789127402.301811:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789500800 00000100:00100000:0.0:1789127402.301825:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789500800 00000100:00100000:0.0:1789127402.301887:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789501312 00000100:00100000:0.0:1789127402.301890:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789501312 00000100:00100000:0.0:1789127402.301907:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789500672 00000100:00100000:0.0:1789127402.301910:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789500672 00000100:00100000:0.0:1789127402.301921:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789500416 00000100:00100000:0.0:1789127402.301924:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789500416 00000100:00100000:0.0:1789127402.301935:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789500928 00000100:00100000:0.0:1789127402.301937:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789500928 00000100:00100000:0.0:1789127402.301948:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789501440 00000100:00100000:0.0:1789127402.301951:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789501440 00000100:00100000:0.0:1789127402.301984:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789127402.301993:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789500800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127402.302090:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789500800:12345-0@lo:400:kworker.0 Request processed in 97us (4939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127402.302097:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1789127402.302201:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789501696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127402.302242:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127402.302306:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789127402.302314:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789501312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127402.302346:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789501312:12345-0@lo:400:kworker.0 Request processed in 33us (5160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127402.302351:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789127402.302362:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789127402.302368:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789500672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127402.302396:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789500672:12345-0@lo:400:kworker.0 Request processed in 28us (5168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127402.302402:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789127402.302426:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789127402.302432:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789500416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127402.302606:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789500416:12345-0@lo:400:kworker.0 Request processed in 30us (4107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127402.302614:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789127402.302628:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789127402.302635:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789500928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127402.302664:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e88780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789500928:12345-0@lo:400:kworker.0 Request processed in 31us (4273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127402.302677:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789127402.302690:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789127402.302696:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789501440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127402.302725:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e89680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789501440:12345-0@lo:400:kworker.0 Request processed in 29us (4290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127402.302730:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789127402.302801:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789500032:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1789127402.302853:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127402.302858:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127402.302860:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127402.302863:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127402.302896:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789500672:0@lo:400:kworker.0 00010000:00080000:0.0:1789127402.302911:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7394f00 x1876035789501184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127402.302921:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789501184:0@lo:400:kworker.0 00000100:00100000:0.0:1789127402.302932:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789500288:0@lo:400:kworker.0 00000100:00100000:0.0:1789127402.302943:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789500800:0@lo:400:kworker.0 00000100:00100000:0.0:1789127402.302953:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789501312:0@lo:400:kworker.0 00000100:00100000:2.0:1789127402.310209:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789501696 00000100:00100000:2.0:1789127402.310222:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789501696 00000100:00100000:2.0:1789127402.310285:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789127402.310295:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789501696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127402.310319:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127402.310396:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789501696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (8153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127402.310403:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1789127402.310788:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ee4b40 x1876035789501696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127402.310809:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789501696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127402.311029:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789500416:0@lo:400:kworker.0 00010000:00080000:3.0:1789127402.311044:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7397480 x1876035789500928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127402.311053:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789500928:0@lo:400:kworker.0 00010000:00080000:3.0:1789127402.311063:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7ebcb40 x1876035789501440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127402.311071:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789501440:0@lo:400:kworker.0 00000100:00100000:3.0:1789127402.311084:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789500544:0@lo:400:kworker.0 00010000:00080000:3.0:1789127402.311096:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7396d00 x1876035789501056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127402.311104:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789501056:0@lo:400:kworker.0 00010000:00080000:3.0:1789127402.311131:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7ebe940 x1876035789501568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127402.311139:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789501568:0@lo:400:kworker.0 00010000:00010000:0.0:1789127402.423678:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127402.808629:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127402.808651:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789501824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127402.808716:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127402.808774:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789501824 00000100:00100000:2.0:1789127402.808780:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789501824 00000100:00100000:2.0:1789127402.808823:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789127402.808831:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789501824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127402.808858:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127402.808901:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789501824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127402.808907:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:2.0:1789127402.808946:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7ebcb40 x1876035789501824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127402.808976:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789501824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127402.811266:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127402.811285:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789501952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127402.811343:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127402.811391:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789501952 00000100:00100000:2.0:1789127402.811398:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789501952 00000100:00100000:2.0:1789127402.811437:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789127402.811446:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789501952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789127402.811476:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127402.811533:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789501952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127402.811540:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1789127402.811571:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7ebcb40 x1876035789501952/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127402.811587:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789501952:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789127403.448418:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789127404.336359:0:13986:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcff4b5de0 20000000:00000080:1.0:1789127404.336377:0:13986:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff934586060000 uarg=0000000000000000 20000000:01000000:1.0:1789127404.336413:0:13986:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1' 20000000:01000000:1.0:1789127404.336419:0:13986:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1' 20000000:01000000:1.0:1789127404.336424:0:13986:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:3.0:1789127404.337111:0:13987:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1789127404.337271:0:13986:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:0.0:1789127404.345890:0:13986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:0.0:1789127404.346047:0:13986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 144 off10272 00000040:00080000:0.0:1789127404.346064:0:13986:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10496 10000000:01000000:0.0:1789127404.346082:0:13986:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789127404.346104:0:13986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346134:0:13986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d6cb expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346143:0:13986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93458858c600/0xd718aadfd785d6e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d6d9 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346152:0:13986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93458858c200/0xd718aadfd785d6e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb7e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346159:0:13986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928fe800/0xd718aadfd785d6f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d6ee expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346166:0:13986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d703 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d6fc expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346173:0:13986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff934587fec200/0xd718aadfd785d70a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb85 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346180:0:13986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346215:0:13986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff934587fec200/0xd718aadfd785d70a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb85 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346228:0:13986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff934587fec200/0xd718aadfd785d70a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb85 expref: 12 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127404.346240:0:13986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13986:1876035789502080:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127404.346387:0:13986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d6fc expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346402:0:13986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d6fc expref: 23 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127404.346412:0:13986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13986:1876035789502208:0@lo:104: 00000100:00100000:0.0:1789127404.346462:0:13986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127404.346505:0:10403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789502208 00010000:00010000:0.0:1789127404.346537:0:13986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928fe800/0xd718aadfd785d6f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d6ee expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346547:0:13986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928fe800/0xd718aadfd785d6f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d6ee expref: 23 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127404.346556:0:13986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73970c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13986:1876035789502336:0@lo:104: 00000100:00100000:0.0:1789127404.346583:0:13986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127404.346619:0:13986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93458858c200/0xd718aadfd785d6e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb7e expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346628:0:13986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93458858c200/0xd718aadfd785d6e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb7e expref: 12 pid: 6514 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127404.346635:0:10403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789502208 00000100:00100000:0.0:1789127404.346639:0:13986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13986:1876035789502464:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127404.346672:0:13986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93458858c600/0xd718aadfd785d6e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d6d9 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346680:0:13986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93458858c600/0xd718aadfd785d6e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d6d9 expref: 23 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127404.346684:0:10403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789502336 00000100:00100000:1.0:1789127404.346689:0:10403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789502336 00000100:00100000:0.0:1789127404.346692:0:13986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13986:1876035789502592:0@lo:104: 00000100:00100000:1.0:1789127404.346720:0:10403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789127404.346726:0:13986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127404.346735:0:10403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7397480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:13986:x1876035789502208:12345-0@lo:104: 00010000:00010000:1.0:1789127404.346749:0:10403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d703 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346758:0:13986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d6cb expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.346768:0:13986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d6cb expref: 23 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127404.346777:0:13986:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13986:1876035789502720:0@lo:104: 00010000:00010000:1.0:1789127404.346806:0:10403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127404.346812:0:13986:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127404.346817:0:10403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7397480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:13986:x1876035789502208:12345-0@lo:104: Request processed in 84us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127404.346826:0:13986:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127404.346833:0:10403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789127404.346848:0:13986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13986:1876035789502208:0@lo:104: 00000100:00100000:1.0:1789127404.346859:0:10403:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789127404.346875:0:10403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789502592 00000100:00100000:1.0:1789127404.346879:0:10403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789502592 00000100:00100000:1.0:1789127404.346893:0:10403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789502720 00000100:00100000:1.0:1789127404.346896:0:10403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789502720 00000100:00100000:1.0:1789127404.346908:0:10403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789127404.346914:0:10403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:13986:x1876035789502336:12345-0@lo:104: 00010000:00010000:1.0:1789127404.346922:0:10403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d6f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.346967:0:10403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789127404.346972:0:10403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+5:13986:x1876035789502336:12345-0@lo:104: Request processed in 59us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127404.346978:0:10403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789127404.346991:0:10403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789127404.346996:0:10403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:13986:x1876035789502592:12345-0@lo:104: 00010000:00010000:1.0:1789127404.347003:0:10403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d6e0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347035:0:10403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789127404.347040:0:10403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:13986:x1876035789502592:12345-0@lo:104: Request processed in 44us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127404.347046:0:10403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789127404.347057:0:10403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789127404.347063:0:10403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:13986:x1876035789502720:12345-0@lo:104: 00010000:00010000:1.0:1789127404.347070:0:10403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d6d2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347104:0:10403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789127404.347108:0:10403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ec3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:13986:x1876035789502720:12345-0@lo:104: Request processed in 47us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127404.347114:0:10403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:1.0:1789127404.347150:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789127404.347155:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d703 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347163:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0a00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127404.347166:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d703 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347175:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d703 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127404.347183:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d703 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127404.347188:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127404.347212:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d703 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347218:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127404.347236:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d703 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347243:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a0a00/0xd718aadfd785d6fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d703 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347264:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789127404.347267:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d6f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347272:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1c00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127404.347275:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d6f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347281:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d6f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127404.347287:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d6f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127404.347291:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127404.347305:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347310:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127404.347324:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347330:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a1c00/0xd718aadfd785d6ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6f5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347340:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127404.347343:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d6e0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347357:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec000 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127404.347361:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d6e0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127404.347361:0:13986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73970c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13986:1876035789502336:0@lo:104: 00010000:00010000:1.0:1789127404.347374:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d6e0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127404.347378:0:13986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13986:1876035789502592:0@lo:104: 10000000:00010000:1.0:1789127404.347386:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d6e0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127404.347391:0:13986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13986:1876035789502720:0@lo:104: 10000000:01000000:1.0:1789127404.347399:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127404.347416:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6e0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347422:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127404.347429:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6e0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347435:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934587fec000/0xd718aadfd785d6d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6e0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347444:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127404.347447:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d6d2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347465:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fede00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127404.347468:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d6d2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347485:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d6d2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127404.347491:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d6d2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127404.347495:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127404.347542:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6d2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347548:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127404.347554:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6d2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347560:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785d6cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d6d2 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.347570:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127404.347572:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127404.347573:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127404.347579:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127404.347590:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789502848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127404.347623:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127404.347647:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127404.348083:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789503232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127404.348114:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127404.348147:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789502976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127404.348167:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127404.348193:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127404.348200:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789503104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127404.348220:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789502848 00000100:00100000:1.0:1789127404.348226:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127404.348228:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789502848 00010000:00010000:0.0:1789127404.348256:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d6fc expref: 24 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127404.348257:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789503232 00000100:00100000:1.0:1789127404.348263:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789503232 00000100:00100000:0.0:1789127404.348280:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789502976 00010000:00010000:1.0:1789127404.348282:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d6cb expref: 25 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127404.348285:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789502976 00010000:00010000:0.0:1789127404.348301:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928fe800/0xd718aadfd785d6f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d6ee expref: 26 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127404.348302:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789503104 00000100:00100000:1.0:1789127404.348306:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789503104 00010000:00010000:1.0:1789127404.348322:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93458858c600/0xd718aadfd785d6e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d6d9 expref: 27 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127404.348325:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789127404.348339:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9de8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+27:3653:x1876035789502848:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127404.348345:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00010000:00010000:0.0:1789127404.348350:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789127404.348355:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+27:3653:x1876035789503232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127404.348360:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d703 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d6fc expref: 27 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.348366:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127404.348371:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d6cb expref: 27 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.348393:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d703 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d6fc expref: 27 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.348718:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d6cb expref: 27 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.348734:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928ff600/0xd718aadfd785d6d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d6cb expref: 27 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.348746:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127404.348827:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+26:3653:x1876035789503232:12345-0@lo:103:ldlm_bl.0 Request processed in 474us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127404.348834:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789127404.348849:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789127404.348862:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+25:3650:x1876035789502976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127404.348870:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127404.348875:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928fe800/0xd718aadfd785d6f5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d6ee expref: 25 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.348883:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928fe800/0xd718aadfd785d6f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d6ee expref: 25 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.348893:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928fe800/0xd718aadfd785d6f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d6ee expref: 25 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.348902:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127404.348930:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789502976:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127404.348936:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789127404.348951:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789127404.348957:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:3650:x1876035789503104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127404.348965:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127404.348968:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93458858c600/0xd718aadfd785d6e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d6d9 expref: 23 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.348976:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93458858c600/0xd718aadfd785d6e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d6d9 expref: 23 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.348985:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93458858c600/0xd718aadfd785d6e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d6d9 expref: 23 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.348992:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127404.349014:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:3650:x1876035789503104:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127404.349026:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789127404.349065:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789503104:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127404.349073:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789502976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127404.349125:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789503232:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127404.349466:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127404.350564:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d703 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d6fc expref: 21 pid: 6514 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.350580:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127404.350630:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9de8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:3653:x1876035789502848:12345-0@lo:103:ldlm_bl.0 Request processed in 2296us (3007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127404.350638:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789127404.350915:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789502848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127404.352207:0:13986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca43c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13986:1876035789502080:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127404.352220:0:13986:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13986:1876035789502464:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127404.352258:0:13986:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127404.353375:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127404.353409:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127404.353481:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771586432 00000100:00100000:1.0:1789127404.353489:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771586432 00010000:00010000:1.0:1789127404.353559:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff934587fec200/0xd718aadfd785d70a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb85 expref: 13 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127404.353582:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771586560 00000100:00100000:1.0:1789127404.353585:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771586560 00010000:00010000:1.0:1789127404.353596:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93458858c200/0xd718aadfd785d6e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb7e expref: 14 pid: 6514 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127404.353618:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:1.0:1789127404.353626:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+14:2401:x1876035771586432:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127404.353638:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127404.353642:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff934587fec200/0xd718aadfd785d70a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb85 expref: 14 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353652:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff934587fec200/0xd718aadfd785d70a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb85 expref: 14 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353667:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587fec200/0xd718aadfd785d70a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb85 expref: 14 pid: 6517 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353680:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127404.353733:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e89e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771586432:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 108us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127404.353741:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:1.0:1789127404.353757:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:1.0:1789127404.353764:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:2401:x1876035771586560:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127404.353772:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127404.353777:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93458858c200/0xd718aadfd785d6e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb7e expref: 12 pid: 6514 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353785:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93458858c200/0xd718aadfd785d6e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb7e expref: 12 pid: 6514 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353795:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93458858c200/0xd718aadfd785d6e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb7e expref: 12 pid: 6514 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353805:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353813:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353832:0:6507:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353839:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353846:0:6507:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353852:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353863:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587feca00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127404.353868:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353876:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353888:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.353898:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127404.353919:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:2401:x1876035771586560:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 156us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127404.353925:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00010000:00010000:0.0:1789127404.354000:0:13986:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.354008:0:13986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127404.354014:0:13986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587feca00/0xd718aadfd785d711 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127404.473801:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127405.052265:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127405.052414:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127405.052640:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127405.052672:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127405.057661:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127405.057700:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771586816 00000100:00100000:1.0:1789127405.057779:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771586816 00000100:00100000:1.0:1789127405.057843:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771587072 00000100:00100000:1.0:1789127405.057846:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771587072 00000100:00100000:1.0:1789127405.057861:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771586944 00000100:00100000:1.0:1789127405.057864:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771586944 00000100:00100000:1.0:1789127405.057880:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 218 00000100:00100000:1.0:1789127405.057890:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771586816:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127405.057958:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e883c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771586816:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 70us (5701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.057965:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 218 00000100:00100000:1.0:1789127405.057980:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 219 00000100:00100000:1.0:1789127405.057986:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771587072:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127405.058021:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771587072:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 36us (5608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.058027:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 219 00000100:00100000:1.0:1789127405.058040:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 220 00000100:00100000:1.0:1789127405.058046:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771586944:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127405.058068:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771586944:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 23us (5396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.058074:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 220 00000100:00080000:1.0:1789127405.058094:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127405.058097:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127405.058318:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771586688 00000100:00100000:2.0:1789127405.058324:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771586688 00000100:00100000:2.0:1789127405.058651:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 367 00000100:00100000:2.0:1789127405.058661:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:2402:x1876035771586688:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127405.058693:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:2402:x1876035771586688:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 35us (6054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127405.058699:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 367 00000100:00100000:1.0:1789127405.059652:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771587200 00000100:00100000:1.0:1789127405.059659:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771587200 00000100:00100000:1.0:1789127405.059706:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 221 00000100:00100000:1.0:1789127405.059715:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692921680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771587200:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127405.059756:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692921680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771587200:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 42us (2103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.059763:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 221 00000100:00080000:1.0:1789127405.059782:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 10000000:01000000:0.0:1789127405.497279:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789127405.497285:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934586ebc000 from 10 10000000:01000000:0.0:1789127405.497290:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127405.497334:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127405.497362:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127405.497374:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127405.497399:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789503360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127405.497482:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127405.497488:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127405.497607:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127405.501427:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789503360 00000100:00100000:2.0:1789127405.501443:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789503360 00000100:00100000:2.0:1789127405.501627:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1789127405.501638:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789503360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127405.501654:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127405.501675:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d71f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d718 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.501849:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d718 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.501862:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d718 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.501873:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ffa00, rc 0) 00000100:00100000:2.0:1789127405.502015:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789503360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 379us (4532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127405.502022:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1789127405.512440:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789503360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127405.512483:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d71f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127405.512496:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d71f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127405.512599:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789503488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127405.512655:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127405.512712:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127405.513384:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789503488 00000100:00100000:2.0:1789127405.513393:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789503488 00000100:00100000:2.0:1789127405.513457:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:2.0:1789127405.513468:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789503488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127405.513620:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789503488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127405.513627:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789127405.516541:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789503488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127405.516608:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789503616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127405.516682:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127405.516742:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127405.517114:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789503616 00000100:00100000:2.0:1789127405.517121:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789503616 00000100:00100000:2.0:1789127405.517177:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:2.0:1789127405.517186:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789503616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127405.517541:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789503616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 355us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127405.517550:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789127405.517823:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789503616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127405.518483:0:14047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14047:1876035789503744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127405.518564:0:14047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127405.518600:0:14047:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0d840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127405.518725:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789503744 00000100:00100000:2.0:1789127405.518731:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789503744 00000100:00100000:2.0:1789127405.518860:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:2.0:1789127405.518873:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:14047:x1876035789503744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127405.518983:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:14047:x1876035789503744:12345-0@lo:502:llog_process_th.0 Request processed in 113us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127405.519040:0:14047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14047:1876035789503744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127405.519065:0:14047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127405.519075:0:14047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127405.519078:0:14047:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127405.519084:0:14047:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff934586ebc000 00000020:00000080:0.0:1789127405.519087:0:14047:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789127405.519200:0:14047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14047:1876035789503872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127405.519238:0:14047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127405.519255:0:14047:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec7d180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127405.521653:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789503872 00000100:00100000:0.0:1789127405.521667:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789503872 00000100:00100000:2.0:1789127405.525969:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1789127405.529119:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1789127405.529137:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:14047:x1876035789503872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127405.529387:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:14047:x1876035789503872:12345-0@lo:502:llog_process_th.0 Request processed in 255us (10147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.529395:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789127405.529615:0:14047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14047:1876035789503872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127405.529650:0:14047:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127405.529658:0:14047:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127405.529660:0:14047:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:0.0:1789127405.529664:0:14047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789127405.530367:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:1.0:1789127405.530394:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127405.530404:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d71f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.530414:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d71f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127405.530423:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789127405.530425:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b6688800 from 10 10000000:01000000:1.0:1789127405.530427:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789127405.530934:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.530943:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.530954:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127405.530975:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789504000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127405.531026:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127405.531059:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ac300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127405.531288:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789504000 00000100:00100000:2.0:1789127405.531297:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789504000 00000100:00100000:2.0:1789127405.531334:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789127405.531342:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789504000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127405.531352:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127405.531363:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928fe600/0xd718aadfd785d72d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d726 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.531384:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928fe600/0xd718aadfd785d72d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d726 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.531394:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928fe600/0xd718aadfd785d72d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d726 expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.531401:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe600, rc 0) 00000100:00100000:2.0:1789127405.531438:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789504000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127405.531474:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1789127405.532186:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789504000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127405.532212:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d72d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.532222:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d72d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127405.532300:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789504128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127405.532343:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127405.532376:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ac300 going to sleep for 11 seconds 00000100:00100000:1.0:1789127405.532391:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789504128 00000100:00100000:1.0:1789127405.532395:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789504128 00000100:00100000:1.0:1789127405.532435:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789127405.532444:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789504128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127405.532578:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789504128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.532586:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:1.0:1789127405.532620:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789504128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127405.532649:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789504256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127405.532688:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127405.533098:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346811ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127405.536321:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789504256 00000100:00100000:2.0:1789127405.536335:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789504256 00000100:00100000:2.0:1789127405.536377:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1789127405.536386:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789504256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127405.536961:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789504256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 575us (4271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127405.536969:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1789127405.537071:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789504256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127405.537255:0:14050:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e85680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14050:1876035789504384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127405.537369:0:14050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127405.537392:0:14050:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127405.537471:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789504384 00000100:00100000:0.0:1789127405.537476:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789504384 00000100:00100000:0.0:1789127405.537529:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789127405.537538:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:14050:x1876035789504384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127405.537617:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:14050:x1876035789504384:12345-0@lo:502:llog_process_th.0 Request processed in 79us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127405.537624:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789127405.538060:0:14050:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e85680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14050:1876035789504384:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127405.538085:0:14050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127405.538095:0:14050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127405.538097:0:14050:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789127405.538104:0:14050:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b6688800 00000020:00000080:2.0:1789127405.538106:0:14050:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789127405.538181:0:14050:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e85680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14050:1876035789504512:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127405.538218:0:14050:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127405.538238:0:14050:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127405.538978:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789504512 00000100:00100000:0.0:1789127405.538985:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789504512 00000100:00100000:0.0:1789127405.539019:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789127405.539027:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:14050:x1876035789504512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127405.539114:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:14050:x1876035789504512:12345-0@lo:502:llog_process_th.0 Request processed in 87us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127405.539121:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789127405.539209:0:14050:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e85680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14050:1876035789504512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127405.539231:0:14050:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127405.539236:0:14050:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127405.539244:0:14050:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789127405.539248:0:14050:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1789127405.539438:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:0.0:1789127405.539479:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127405.539489:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d72d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127405.539499:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d72d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127405.539533:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789127405.539536:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b640b000 from 10 10000000:01000000:0.0:1789127405.539539:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127405.539565:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127405.539573:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127405.539582:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127405.539598:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789504640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127405.539629:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127405.539653:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b9fea600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127405.539878:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789504640 00000100:00100000:2.0:1789127405.539883:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789504640 00000100:00100000:2.0:1789127405.539920:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789127405.539928:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789504640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127405.539936:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127405.539947:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928ff400/0xd718aadfd785d73b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d734 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.539965:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928ff400/0xd718aadfd785d73b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d734 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.539975:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928ff400/0xd718aadfd785d73b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d734 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.539983:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff400, rc 0) 00000100:00100000:2.0:1789127405.540015:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789504640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127405.540021:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789127405.540052:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789504640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127405.540065:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d73b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.540073:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d73b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127405.540120:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e85680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789504768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127405.540156:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127405.540174:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346903513c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127405.540184:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789504768 00000100:00100000:2.0:1789127405.540187:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789504768 00000100:00100000:2.0:1789127405.540206:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789127405.540211:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789504768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127405.541135:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789504768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 920us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127405.541143:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789127405.545989:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e85680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789504768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127405.546567:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789504896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127405.546642:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127405.546681:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ac300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127405.547168:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789504896 00000100:00100000:2.0:1789127405.547176:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789504896 00000100:00100000:2.0:1789127405.547219:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789127405.547228:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789504896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127405.547345:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789504896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127405.547352:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1789127405.547537:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789504896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127405.548145:0:14051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14051:1876035789505024:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127405.548191:0:14051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127405.548223:0:14051:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ac300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127405.548279:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789505024 00000100:00100000:2.0:1789127405.548284:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789505024 00000100:00100000:2.0:1789127405.548320:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1789127405.548327:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:14051:x1876035789505024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127405.548587:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:14051:x1876035789505024:12345-0@lo:502:llog_process_th.0 Request processed in 260us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127405.548595:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789127405.549411:0:14051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14051:1876035789505024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127405.551378:0:14051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127405.551393:0:14051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127405.551395:0:14051:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127405.551408:0:14051:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b640b000 00000020:00000080:1.0:1789127405.551411:0:14051:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789127405.553394:0:14051:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14051:1876035789505152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127405.553485:0:14051:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127405.553549:0:14051:0:(client.c:2715:ptlrpc_set_wait()) set ffff934692ad23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127405.553889:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789505152 00000100:00100000:2.0:1789127405.553897:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789505152 00000100:00100000:2.0:1789127405.553937:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1789127405.553946:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934688ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:14051:x1876035789505152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127405.554055:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934688ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:14051:x1876035789505152:12345-0@lo:502:llog_process_th.0 Request processed in 109us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127405.554062:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1789127405.555415:0:14051:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14051:1876035789505152:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127405.555478:0:14051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127405.555488:0:14051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127405.555490:0:14051:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:1.0:1789127405.555498:0:14051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789127405.555724:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1789127405.555751:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127405.555762:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d73b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.555783:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d73b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127405.555794:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127405.555797:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934687bf9800 from 10 10000000:01000000:2.0:1789127405.555800:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127405.555830:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.555839:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.555849:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127405.555867:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e87c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789505280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127405.555914:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127405.555957:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351540 going to sleep for 11 seconds 00000100:00100000:1.0:1789127405.556153:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789505280 00000100:00100000:1.0:1789127405.556160:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789505280 00000100:00100000:1.0:1789127405.556202:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:1.0:1789127405.556210:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934688ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789505280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127405.556220:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127405.556231:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93458858d800/0xd718aadfd785d749 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d742 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.556252:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93458858d800/0xd718aadfd785d749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d742 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.556261:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93458858d800/0xd718aadfd785d749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d742 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.556281:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858d800, rc 0) 00000100:00100000:1.0:1789127405.556315:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934688ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789505280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.556323:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1789127405.557148:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e87c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789505280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127405.557167:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d749 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.557188:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d749 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127405.557248:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e87c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789505408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127405.557295:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127405.557327:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351540 going to sleep for 11 seconds 00000100:00100000:1.0:1789127405.557433:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789505408 00000100:00100000:1.0:1789127405.557438:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789505408 00000100:00100000:1.0:1789127405.557500:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789127405.557529:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789505408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127405.557630:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789505408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.557638:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1789127405.557663:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e87c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789505408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127405.557705:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789505536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127405.557744:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127405.557756:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934691347540 going to sleep for 11 seconds 00000100:00100000:1.0:1789127405.557848:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789505536 00000100:00100000:1.0:1789127405.557852:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789505536 00000100:00100000:1.0:1789127405.557868:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789127405.557874:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789505536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127405.557944:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789505536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.557950:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789127405.557980:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789505536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127405.558138:0:14052:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14052:1876035789505664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127405.558170:0:14052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127405.558187:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789505664 00000100:00100000:1.0:1789127405.558191:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789505664 00000100:00100000:1.0:1789127405.558206:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789127405.558211:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:14052:x1876035789505664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127405.558577:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:14052:x1876035789505664:12345-0@lo:502:llog_process_th.0 Request processed in 363us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.558590:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789127405.558618:0:14052:0:(client.c:2715:ptlrpc_set_wait()) set ffff934691347d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127405.558631:0:14052:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14052:1876035789505664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127405.558651:0:14052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127405.558659:0:14052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127405.558662:0:14052:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127405.558670:0:14052:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff934687bf9800 00000020:00000080:1.0:1789127405.558673:0:14052:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789127405.558748:0:14052:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14052:1876035789505792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127405.558954:0:14052:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127405.558974:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789505792 00000100:00100000:1.0:1789127405.558978:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789505792 00000100:00100000:1.0:1789127405.558997:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789127405.559002:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:14052:x1876035789505792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127405.559063:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:14052:x1876035789505792:12345-0@lo:502:llog_process_th.0 Request processed in 60us (109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.559070:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1789127405.559102:0:14052:0:(client.c:2715:ptlrpc_set_wait()) set ffff934691347d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127405.559114:0:14052:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14052:1876035789505792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127405.559130:0:14052:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127405.559134:0:14052:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127405.559135:0:14052:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:1.0:1789127405.559139:0:14052:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1789127405.559182:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:1.0:1789127405.559201:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127405.559209:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d749 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127405.559224:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d749 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127405.566737:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127405.566772:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771587328 00000100:00100000:2.0:1789127405.566781:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771587328 00000100:00100000:2.0:1789127405.566835:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 388 00000100:00100000:2.0:1789127405.566845:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:6173:x1876035771587328:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127405.566861:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127405.566877:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928ff600/0xd718aadfd785d750 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffb8c expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.566902:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928ff600/0xd718aadfd785d750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb8c expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.566914:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928ff600/0xd718aadfd785d750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb8c expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127405.566923:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff600, rc 0) 00000100:00100000:2.0:1789127405.566972:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771587328:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 129us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127405.566980:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 388 00000100:00100000:2.0:1789127405.576276:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127405.576394:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771587456 00000100:00100000:3.0:1789127405.576405:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771587456 00000100:00100000:3.0:1789127405.576468:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 389 00000100:00100000:3.0:1789127405.576478:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771587456:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127405.576644:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771587456:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 167us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127405.576652:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 389 00000100:00100000:1.0:1789127405.580293:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127405.580398:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771587584 00000100:00100000:3.0:1789127405.580408:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771587584 00000100:00100000:3.0:1789127405.580472:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 390 00000100:00100000:3.0:1789127405.580483:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771587584:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127405.580638:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771587584:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 156us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127405.580657:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 390 00000100:00100000:0.0:1789127405.587216:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127405.588881:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771587712 00000100:00100000:1.0:1789127405.588894:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771587712 00000100:00100000:1.0:1789127405.588944:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 391 00000100:00100000:1.0:1789127405.588954:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:10391:x1876035771587712:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127405.589187:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:10391:x1876035771587712:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 233us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.589196:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 391 00000100:00100000:0.0:1789127405.600877:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127405.601059:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771587840 00000100:00100000:2.0:1789127405.601067:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771587840 00000100:00100000:2.0:1789127405.601112:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 392 00000100:00100000:2.0:1789127405.601122:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:10391:x1876035771587840:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127405.601245:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:10391:x1876035771587840:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 124us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127405.601253:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 392 00000100:00100000:1.0:1789127405.615760:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127405.615875:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771587968 00000100:00100000:0.0:1789127405.615884:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771587968 00000100:00100000:0.0:1789127405.615936:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 393 00000100:00100000:0.0:1789127405.615946:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771587968:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127405.615962:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127405.615978:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fec400/0xd718aadfd785d757 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffb93 expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127405.616004:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fec400/0xd718aadfd785d757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb93 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127405.616015:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fec400/0xd718aadfd785d757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb93 expref: 13 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127405.616024:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec400, rc 0) 00000100:00100000:0.0:1789127405.616081:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771587968:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 136us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127405.616089:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 393 00000100:00100000:0.0:1789127405.618938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127405.619013:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771588096 00000100:00100000:1.0:1789127405.619022:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771588096 00000100:00100000:1.0:1789127405.619071:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 394 00000100:00100000:1.0:1789127405.619081:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771588096:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127405.619215:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771588096:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 135us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.619223:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 394 00000100:00100000:1.0:1789127405.622548:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127405.622633:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771588224 00000100:00100000:2.0:1789127405.622643:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771588224 00000100:00100000:2.0:1789127405.622705:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 395 00000100:00100000:2.0:1789127405.622715:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771588224:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127405.622847:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771588224:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 133us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127405.622855:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 395 00000100:00100000:2.0:1789127405.628370:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127405.628503:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771588352 00000100:00100000:0.0:1789127405.628606:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771588352 00000100:00100000:1.0:1789127405.628811:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 396 00000100:00100000:1.0:1789127405.628823:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:10394:x1876035771588352:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127405.628961:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:10394:x1876035771588352:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 140us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.628979:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 396 00000100:00100000:0.0:1789127405.632873:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127405.635820:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771588480 00000100:00100000:1.0:1789127405.635835:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771588480 00000100:00100000:1.0:1789127405.635955:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 397 00000100:00100000:1.0:1789127405.635966:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:10394:x1876035771588480:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127405.636173:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:10394:x1876035771588480:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 208us (3307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127405.636182:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 397 00010000:00010000:3.0:1789127406.519661:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127406.910892:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789505920:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127406.910964:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127406.911035:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789505920 00000100:00100000:1.0:1789127406.911042:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789505920 00000100:00100000:1.0:1789127406.911087:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789127406.911096:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789505920:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127406.911128:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789127406.911172:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789505920:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127406.911179:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1789127406.911224:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789505920:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127407.425231:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346929203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789506176:0@lo:400:kworker.0 00000100:00100000:2.0:1789127407.426404:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127407.426802:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789506176 00000100:00100000:2.0:1789127407.426810:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789506176 00000100:00100000:2.0:1789127407.426851:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1789127407.426859:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789506176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127407.426912:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789506176:12345-0@lo:400:kworker.0 Request processed in 54us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127407.426919:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1789127407.426991:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346929203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789506176:0@lo:400:kworker.0 00000100:00100000:2.0:1789127407.427015:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127407.427023:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789506560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127407.427053:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127407.427079:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789506560 00000100:00100000:2.0:1789127407.427082:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789506560 00000100:00100000:2.0:1789127407.427114:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789127407.427121:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789506560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127407.427144:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127407.427177:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e85e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789506560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127407.427184:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:2.0:1789127407.427212:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e87480 x1876035789506560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127407.427229:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789506560:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127407.431735:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692923c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789506304:0@lo:400:kworker.0 00000100:00100000:0.0:1789127407.431808:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127407.431875:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127407.431883:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789506432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127407.431910:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789127407.431937:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127407.431952:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789506304 00000100:00100000:0.0:1789127407.431958:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789506304 00000100:00100000:0.0:1789127407.432000:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789127407.432009:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789506304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127407.432074:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789506304:12345-0@lo:400:kworker.0 Request processed in 66us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127407.432082:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789127407.432103:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789506432 00000100:00100000:0.0:1789127407.432106:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789506432 00000100:00100000:0.0:1789127407.432135:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789127407.432142:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789506432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127407.432157:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127407.432188:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789506432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127407.432194:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1789127407.432227:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebe940 x1876035789506432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127407.432247:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789506432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127407.432259:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692923c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789506304:0@lo:400:kworker.0 00000100:00080000:0.0:1789127407.432283:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127407.436933:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789506048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127407.437010:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127407.439399:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692921e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789506816:0@lo:400:kworker.0 00000100:00100000:3.0:1789127407.439471:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127407.439479:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692922580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789506944:0@lo:400:kworker.0 00000100:00100000:3.0:1789127407.439525:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346929203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789507328:0@lo:400:kworker.0 00000100:00100000:1.0:1789127407.439526:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127407.439545:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789507456:0@lo:400:kworker.0 00000100:00100000:3.0:1789127407.439548:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127407.439580:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127407.439582:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789506816 00000100:00100000:3.0:1789127407.439588:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789506816 00000100:00100000:1.0:1789127407.439606:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789506944 00000100:00100000:1.0:1789127407.439609:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789506944 00000100:00100000:1.0:1789127407.439629:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789507328 00000100:00100000:3.0:1789127407.439630:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789507456 00000100:00100000:3.0:1789127407.439632:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789507456 00000100:00100000:1.0:1789127407.439632:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789507328 00000100:00100000:1.0:1789127407.439648:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1789127407.439656:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789506944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127407.439702:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346929221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789506688:0@lo:400:kworker.0 00000100:00100000:1.0:1789127407.439708:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789506944:12345-0@lo:400:kworker.0 Request processed in 53us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127407.439748:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127407.439761:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692923c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789507200:0@lo:400:kworker.0 00000100:00100000:2.0:1789127407.439785:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127407.439805:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127407.439810:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789507072:0@lo:400:kworker.0 00000100:00100000:2.0:1789127407.439829:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127407.439878:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789506688 00000100:00100000:2.0:1789127407.439882:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789506688 00000100:00100000:0.0:1789127407.443010:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789506048 00000100:00100000:0.0:1789127407.443025:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789506048 00000100:00100000:0.0:1789127407.443096:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789127407.443122:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789506048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789127407.443161:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127407.443240:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789506048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (6228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127407.443247:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789127407.443278:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789507200 00000100:00100000:0.0:1789127407.443282:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789507200 00000100:00100000:0.0:1789127407.443321:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789507072 00000100:00100000:0.0:1789127407.443325:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789507072 00000100:00100000:0.0:1789127407.443344:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789127407.443351:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789507200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127407.443395:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789507200:12345-0@lo:400:kworker.0 Request processed in 44us (3608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127407.443402:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789127407.443554:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789127407.443563:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789507072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127407.443599:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789507072:12345-0@lo:400:kworker.0 Request processed in 38us (3768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127407.443605:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1789127407.443646:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692920000 x1876035789507072/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127407.443662:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789507072:0@lo:400:kworker.0 00010000:00080000:0.0:1789127407.443679:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692923c00 x1876035789507200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127407.443688:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692923c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789507200:0@lo:400:kworker.0 00010000:00080000:0.0:1789127407.443751:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692922580 x1876035789506944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127407.443762:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692922580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789506944:0@lo:400:kworker.0 00000100:00100000:0.0:1789127407.443796:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789506048:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1789127407.443866:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127407.443872:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127407.443875:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127407.448530:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789127407.448763:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692956d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789506816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127407.448869:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692956d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789506816:12345-0@lo:400:kworker.0 Request processed in 326us (9398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127407.448878:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789127407.448934:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692921e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789506816:0@lo:400:kworker.0 00000100:00100000:3.0:1789127407.448966:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789127407.448974:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692954f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789507328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127407.449009:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692954f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789507328:12345-0@lo:400:kworker.0 Request processed in 36us (9459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127407.449015:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789127407.449039:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346929203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789507328:0@lo:400:kworker.0 00000100:00100000:3.0:1789127407.449059:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789127407.449066:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789507456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127407.449122:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789507456:12345-0@lo:400:kworker.0 Request processed in 57us (9542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127407.449129:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00010000:00080000:3.0:1789127407.450084:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692957c00 x1876035789507456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127407.450097:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789507456:0@lo:400:kworker.0 00000100:00100000:1.0:1789127407.450991:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789127407.454639:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789127407.454663:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789506688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127407.454781:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789506688:12345-0@lo:400:kworker.0 Request processed in 130us (15032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127407.454791:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789127407.454829:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346929221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789506688:0@lo:400:kworker.0 00010000:00010000:1.0:1789127407.545356:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127407.927879:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127407.927900:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789507584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127407.927963:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127407.928159:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789507584 00000100:00100000:2.0:1789127407.928166:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789507584 00000100:00100000:2.0:1789127407.928235:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789127407.928245:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789507584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127407.928274:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127407.928331:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789507584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127407.928347:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1789127407.928680:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebf840 x1876035789507584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127407.928705:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789507584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127407.933869:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789507712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789127407.933959:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127407.934168:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789507712 00000100:00100000:0.0:1789127407.934177:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789507712 00000100:00100000:0.0:1789127407.934238:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789127407.934248:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789507712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789127407.934269:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127407.934319:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789507712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127407.934327:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1789127407.934344:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692957480 x1876035789507712/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127407.934366:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789507712:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789127408.574058:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127409.591701:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789127410.153264:0:14189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 07:50:07 (1789127407) === 00000100:00100000:0.0:1789127410.182869:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127410.182914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127410.182938:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127410.182960:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127410.182981:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127410.183005:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771588864 00000100:00100000:0.0:1789127410.183259:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771588864 00000100:00100000:0.0:1789127410.183308:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771589120 00000100:00100000:0.0:1789127410.183317:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771589120 00000100:00100000:0.0:1789127410.183408:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771588736 00000100:00100000:0.0:1789127410.183412:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771588736 00000100:00100000:0.0:1789127410.183438:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 228 00000100:00100000:0.0:1789127410.183448:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771588864:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127410.183545:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771588864:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 98us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127410.183552:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 228 00000100:00100000:0.0:1789127410.183568:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771588992 00000100:00100000:0.0:1789127410.183572:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771588992 00000100:00100000:0.0:1789127410.183589:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 229 00000100:00100000:0.0:1789127410.183595:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771589120:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127410.183622:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771589120:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 27us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127410.183629:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 229 00000100:00100000:0.0:1789127410.183642:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 230 00000100:00100000:0.0:1789127410.183648:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2399:x1876035771588736:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127410.183672:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2399:x1876035771588736:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127410.183678:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 230 00000100:00100000:0.0:1789127410.183689:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 231 00000100:00100000:0.0:1789127410.183696:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692921e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771588992:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127410.183721:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692921e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771588992:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127410.183727:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 231 00000100:00080000:0.0:1789127410.183758:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127410.183763:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127410.183943:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771588608 00000100:00100000:2.0:1789127410.183948:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771588608 00000100:00100000:2.0:1789127410.183985:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 399 00000100:00100000:2.0:1789127410.183992:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771588608:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127410.184032:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771588608:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 40us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127410.184038:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 399 00010000:00010000:1.0:1789127410.615744:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127411.643901:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127411.675231:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127411.675280:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127411.675306:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771589248 00000100:00100000:0.0:1789127411.675317:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771589248 00000100:00100000:3.0:1789127411.675356:0:6532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771589376 00000100:00100000:3.0:1789127411.675362:0:6532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771589376 00000100:00100000:0.0:1789127411.675384:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:0.0:1789127411.675396:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2399:x1876035771589248:12345-192.168.206.48@tcp:41:mkdir.0 00000100:00100000:3.0:1789127411.675407:0:6532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:3.0:1789127411.675429:0:6532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:10767:x1876035771589376:12345-192.168.206.48@tcp:700:mkdir.0 00000004:00000024:0.0:1789127411.675443:0:6522:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789127411.675505:0:6532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e87c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:10767:x1876035771589376:12345-192.168.206.48@tcp:700:mkdir.0 Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127411.675539:0:6532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:0.0:1789127411.675546:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e87840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2399:x1876035771589248:12345-192.168.206.48@tcp:41:mkdir.0 Request processed in 151us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127411.675555:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:1.0:1789127411.681301:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127411.681384:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771589632 00000100:00100000:0.0:1789127411.681393:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771589632 00000100:00100000:0.0:1789127411.681458:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:0.0:1789127411.681468:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:10767:x1876035771589632:12345-192.168.206.48@tcp:36:mkdir.0 00010000:00010000:0.0:1789127411.681558:0:9447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127411.681601:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346813c9e00/0xd718aadfd785d566 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaeb expref: 6 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.681620:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346a69cb400) 00010000:00010000:0.0:1789127411.681631:0:9447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127411.681707:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d75e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.681720:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d75e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.681729:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d75e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683039:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d765 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683056:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d765 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683068:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d765 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683614:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d76c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683625:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d76c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683633:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d76c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127411.683648:0:9447:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004d4749b6 reply state 00000000de7d6bd0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d76c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683657:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d76c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683664:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9346a69cb200) 00010000:00010000:0.0:1789127411.683666:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127411.683669:0:9447:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789127411.683674:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789127411.683681:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d75e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683687:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d75e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683700:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d75e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683706:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127411.683710:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d75e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683717:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d75e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683728:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346a69cbe00) 00010000:00010000:0.0:1789127411.683731:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127411.683734:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d75e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683740:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d75e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127411.683756:0:9447:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004d4749b6 reply state 00000000de7d6bd0 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d765 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683764:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d765 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.683770:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9346a69cbd00) 00010000:00010000:0.0:1789127411.683772:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127411.683774:0:9447:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789127411.683870:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:10767:x1876035771589632:12345-192.168.206.48@tcp:36:mkdir.0 Request processed in 2401us (2575us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789127411.683879:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:0.0:1789127411.695724:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127411.700479:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771589760 00000100:00100000:1.0:1789127411.700497:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771589760 00000100:00100000:1.0:1789127411.700592:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:1.0:1789127411.700605:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692922580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:10768:x1876035771589760:12345-192.168.206.48@tcp:101:chmod.0 00010000:00010000:1.0:1789127411.700642:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127411.700682:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d773 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffb9a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.700846:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785d77a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.700860:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785d77a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.700878:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785d77a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127411.700923:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789127411.700927:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127411.700963:0:6522:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785d77a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.701082:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d773 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb9a expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.701101:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785d77a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb9a expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.701110:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93468b042400) 00010000:00010000:1.0:1789127411.701112:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127411.701116:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c800, rc 0) 00000100:00100000:1.0:1789127411.701182:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692922580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:10768:x1876035771589760:12345-192.168.206.48@tcp:101:chmod.0 Request processed in 580us (5467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127411.701190:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:2.0:1789127411.705468:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127411.705796:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771590016 00000100:00100000:0.0:1789127411.705807:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771590016 00000100:00100000:0.0:1789127411.705865:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:0.0:1789127411.705876:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:10768:x1876035771590016:12345-192.168.206.48@tcp:36:chmod.0 00010000:00010000:0.0:1789127411.705926:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127411.705950:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785d77a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb9a expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.705966:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff93468b042400) 00010000:00010000:0.0:1789127411.705975:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127411.705999:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d781 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.706011:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d781 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.706020:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d781 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127411.706389:0:6523:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006aeefcb7 reply state 00000000ec268ef1 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d781 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.706402:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d781 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.706408:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346a69cbe00) 00010000:00010000:0.0:1789127411.706425:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789127411.706428:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789127411.706435:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789127411.706596:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e85680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:10768:x1876035771590016:12345-192.168.206.48@tcp:36:chmod.0 Request processed in 721us (1136us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789127411.706613:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:0.0:1789127411.750111:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127411.753018:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771590144 00000100:00100000:1.0:1789127411.753033:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771590144 00000100:00100000:1.0:1789127411.753110:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:1.0:1789127411.753121:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692923c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:10769:x1876035771590144:12345-192.168.206.48@tcp:101:chown.0 00010000:00010000:1.0:1789127411.753143:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127411.753163:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d788 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffba1 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.753221:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785d78f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.753233:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785d78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.753245:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785d78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127411.753281:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789127411.753285:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127411.753319:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785d78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.753343:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d788 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffba1 expref: 11 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.753363:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785d78f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffba1 expref: 10 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.753371:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346a69cbe00) 00010000:00010000:1.0:1789127411.753373:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127411.753390:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858cc00, rc 0) 00000100:00100000:1.0:1789127411.753475:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692923c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+10:10769:x1876035771590144:12345-192.168.206.48@tcp:101:chown.0 Request processed in 355us (3373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127411.753484:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:2.0:1789127411.759078:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127411.759174:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771590272 00000100:00100000:0.0:1789127411.759183:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771590272 00000100:00100000:0.0:1789127411.759236:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:0.0:1789127411.759245:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+10:10769:x1876035771590272:12345-192.168.206.48@tcp:101:chown.0 00010000:00010000:0.0:1789127411.759263:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127411.759282:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785d796 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffba8 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759342:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d79d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759355:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d79d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759366:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d79d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759376:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759383:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759389:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759466:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d7ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759490:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d7ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759496:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d7ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127411.759572:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789127411.759576:0:9447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127411.759596:0:9447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d7ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759608:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d79d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759763:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d79d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759773:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d79d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759779:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fedc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127411.759783:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d79d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759791:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d79d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759803:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346a69cbe00) 00010000:00010000:0.0:1789127411.759806:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127411.759811:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d79d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759827:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d79d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759839:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759845:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759851:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759856:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127411.759860:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759867:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759875:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9346a69cbd00) 00010000:00010000:0.0:1789127411.759877:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127411.759881:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759886:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759910:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785d796 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffba8 expref: 12 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759924:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d7ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffba8 expref: 11 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.759938:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9346a69cb200) 00010000:00010000:0.0:1789127411.759940:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127411.759943:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fed800, rc 0) 00000100:00100000:0.0:1789127411.760046:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+11:10769:x1876035771590272:12345-192.168.206.48@tcp:101:chown.0 Request processed in 801us (976us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127411.760054:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:2.0:1789127411.772131:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127411.772281:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771590400 00000100:00100000:0.0:1789127411.772291:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771590400 00000100:00100000:0.0:1789127411.772353:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1789127411.772364:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+11:10769:x1876035771590400:12345-192.168.206.48@tcp:900:chown.0 00000100:00100000:0.0:1789127411.772579:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+11:10769:x1876035771590400:12345-192.168.206.48@tcp:900:chown.0 Request processed in 216us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127411.772588:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1789127411.776019:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127411.776290:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771590656 00000100:00100000:1.0:1789127411.776301:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771590656 00000100:00100000:1.0:1789127411.776367:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:1.0:1789127411.776378:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+11:10769:x1876035771590656:12345-192.168.206.48@tcp:36:chown.0 00010000:00010000:1.0:1789127411.776453:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127411.776482:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785d7ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffba8 expref: 11 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.776498:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9346a69cb200) 00010000:00010000:1.0:1789127411.776503:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127411.776581:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d7b2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.776594:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.776604:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789127411.778458:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:0.0:1789127411.778570:0:6524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003cd0b9ed reply state 0000000042f2ede8 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d7b2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.778589:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d7b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.778598:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9346a69cb200) 00010000:00010000:0.0:1789127411.778601:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789127411.778605:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789127411.778614:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:0.0:1789127411.778697:0:6524:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1789127411.778720:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:10769:x1876035771590656:12345-192.168.206.48@tcp:36:chown.0 Request processed in 2342us (2709us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789127411.778740:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00010000:00010000:3.0:1789127411.778863:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d7b2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.778872:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d7b2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.778880:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d7b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.778886:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858ca00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127411.778891:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d7b2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.778904:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d7b2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.778918:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9346a69cb200) 00010000:00010000:3.0:1789127411.778920:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789127411.778924:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d7b2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.778931:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785d7b2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792786:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d765 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792802:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d765 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792809:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d765 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792815:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587feca00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127411.792819:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d765 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792827:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d765 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792843:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9346a69cbd00) 00010000:00010000:0.0:1789127411.792846:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127411.792851:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d765 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792857:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d765 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792881:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d76c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792887:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d76c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792913:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d76c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792918:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127411.792921:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d76c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792927:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d76c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792936:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9346a69cb200) 00010000:00010000:0.0:1789127411.792939:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127411.792942:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d76c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792947:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d76c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792963:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d781 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792970:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d781 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792975:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d781 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792980:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fede00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127411.792983:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d781 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.792999:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d781 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.793007:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346a69cbe00) 00010000:00010000:0.0:1789127411.793010:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789127411.793013:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d781 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.793018:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d781 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127411.800468:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127411.800705:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771590784 00000100:00100000:0.0:1789127411.800714:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771590784 00000100:00100000:0.0:1789127411.800811:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:0.0:1789127411.800823:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587839680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:10770:x1876035771590784:12345-192.168.206.48@tcp:101:touch.500 00010000:00010000:0.0:1789127411.800846:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127411.800877:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d7b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffbaf expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789127411.803480:0:9447:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2555us 00010000:00010000:3.0:1789127411.839400:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d7c0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839527:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839543:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839562:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d7c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839570:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839577:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839702:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d7ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839719:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d7ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839726:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d7ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127411.839759:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789127411.839763:0:9447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127411.839801:0:9447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d7ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839813:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d7c0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839820:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d7c0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839826:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839831:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127411.839834:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839841:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d7c0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839852:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346a69cbe00) 00010000:00010000:3.0:1789127411.839855:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127411.839859:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d7c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839874:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d7c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839887:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839893:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d7c7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839898:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839902:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127411.839905:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839912:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d7c7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839919:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff934586ef4a00) 00010000:00010000:3.0:1789127411.839922:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127411.839924:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d7c7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839929:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d7c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839966:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d7b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbaf expref: 8 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839979:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d7ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbaf expref: 7 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.839992:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff934586ef4800) 00010000:00010000:3.0:1789127411.839995:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789127411.839997:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a1200, rc 0) 00000100:00100000:3.0:1789127411.840065:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587839680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:10770:x1876035771590784:12345-192.168.206.48@tcp:101:touch.500 Request processed in 39244us (39605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127411.840074:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:2.0:1789127411.845386:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127411.845784:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771591040 00000100:00100000:0.0:1789127411.845795:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771591040 00000100:00100000:0.0:1789127411.845854:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:0.0:1789127411.845864:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587838b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:10770:x1876035771591040:12345-192.168.206.48@tcp:101:touch.500 00010000:00010000:0.0:1789127411.845885:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127411.845906:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d7d5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffbb6 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846006:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785d7dc lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846032:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785d7dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846043:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785d7dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846059:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7e3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846066:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846073:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789127411.846685:0:6522:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789127411.846821:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d7ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846832:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d7ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846840:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d7ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846872:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785d7dc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846879:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785d7dc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846886:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785d7dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846899:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127411.846904:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785d7dc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846911:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785d7dc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846923:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff934586ef4800) 00010000:00010000:0.0:1789127411.846926:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127411.846930:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785d7dc lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846936:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785d7dc lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127411.846950:0:6522:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000511303f7 reply state 00000000dd306631 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846962:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.846967:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff9346a69cb200) 00010000:00010000:0.0:1789127411.846969:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127411.846972:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789127411.847000:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d7d5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbb6 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.847014:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d7ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbb6 expref: 9 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127411.847034:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:0.0:1789127411.847036:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127411.847039:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fedc00, rc 0) 00000100:00100000:2.0:1789127411.848921:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587838b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+10:10770:x1876035771591040:12345-192.168.206.48@tcp:101:touch.500 Request processed in 3050us (3535us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789127411.848934:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:0.0:1789127411.858362:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127411.858462:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771591296 00000100:00100000:2.0:1789127411.858472:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771591296 00000100:00100000:2.0:1789127411.858561:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:2.0:1789127411.858572:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+10:10770:x1876035771591296:12345-192.168.206.48@tcp:36:touch.500 00010000:00010000:2.0:1789127411.858627:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127411.858652:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d7ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbb6 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.858671:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:2.0:1789127411.858681:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127411.858734:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d7f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.858748:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.858757:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127411.858857:0:6523:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b08908d8 reply state 00000000e9d8c795 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d7f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.858870:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d7f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.858876:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9346b6d52e00) 00010000:00010000:2.0:1789127411.858891:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789127411.858894:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789127411.858986:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+11:10770:x1876035771591296:12345-192.168.206.48@tcp:36:touch.500 Request processed in 416us (635us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789127411.858994:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:0.0:1789127411.863285:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127411.863344:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771591424 00000100:00100000:1.0:1789127411.863354:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771591424 00000100:00100000:1.0:1789127411.863423:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:1.0:1789127411.863434:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+11:10770:x1876035771591424:12345-192.168.206.48@tcp:101:touch.500 00010000:00010000:1.0:1789127411.863470:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127411.863489:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785d7ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffbbd expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.863574:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785d7ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbbd expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.863589:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785d7ff lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbbd expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.863605:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9346b6d52e00) 00010000:00010000:1.0:1789127411.863609:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789127411.863613:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858de00, rc 0) 00000100:00100000:1.0:1789127411.863682:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+12:10770:x1876035771591424:12345-192.168.206.48@tcp:101:touch.500 Request processed in 250us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127411.863690:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:0.0:1789127411.874754:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127411.874865:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771591552 00000100:00100000:2.0:1789127411.874876:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771591552 00000100:00100000:2.0:1789127411.874937:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:2.0:1789127411.874946:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2398:x1876035771591552:12345-192.168.206.48@tcp:8:touch.500 00010000:00080000:2.0:1789127411.874982:0:8438:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:2.0:1789127411.875015:0:8438:0:(genops.c:1385:class_connect()) connect: client 2eecd753-97f2-4dc9-9442-17e5ef8fda22, cookie 0xd718aadfd785d806 00002000:00100000:2.0:1789127411.875028:0:8438:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2eecd753-97f2-4dc9-9442-17e5ef8fda22/ffff934587ff2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789127411.875047:0:8438:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789127411.875123:0:8438:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789127411.875151:0:8438:0:(import.c:65:import_set_state_nolock()) ffff934587ff0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127411.875227:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2398:x1876035771591552:12345-192.168.206.48@tcp:8:touch.500 Request processed in 280us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127411.875235:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:0.0:1789127411.893379:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127411.893558:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771591680 00000100:00100000:2.0:1789127411.893568:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771591680 00000100:00100000:2.0:1789127411.893633:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:2.0:1789127411.893643:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:0:x1876035771591680:12345-192.168.206.48@tcp:2:touch.500 00000100:00080000:0.0:1789127411.894256:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789127411.903272:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1789127411.903287:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000100:00100000:2.0:1789127411.903711:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:0:x1876035771591680:12345-192.168.206.48@tcp:2:touch.500 Request processed in 10062us (10333us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789127411.903724:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:3.0:1789127411.916762:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127411.916877:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771591936 00000100:00100000:1.0:1789127411.916887:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771591936 00000100:00100000:1.0:1789127411.916938:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:1.0:1789127411.916948:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692954780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+12:10770:x1876035771591936:12345-192.168.206.48@tcp:35:touch.500 00000100:00100000:1.0:1789127411.917245:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692954780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+13:10770:x1876035771591936:12345-192.168.206.48@tcp:35:touch.500 Request processed in 296us (490us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789127411.917253:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:0.0:1789127411.939810:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127411.939921:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771592064 00000100:00100000:2.0:1789127411.939945:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771592064 00000100:00100000:2.0:1789127411.940006:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:2.0:1789127411.940016:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+13:10771:x1876035771592064:12345-192.168.206.48@tcp:101:rm.0 00010000:00010000:2.0:1789127411.940039:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127411.940059:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7600/0xd718aadfd785d80d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffbc4 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.940142:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7400/0xd718aadfd785d814 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.940167:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7400/0xd718aadfd785d814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.940180:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7400/0xd718aadfd785d814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127411.940223:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789127411.940227:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127411.940264:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7400/0xd718aadfd785d814 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.940289:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7600/0xd718aadfd785d80d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbc4 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.940305:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7400/0xd718aadfd785d814 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbc4 expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.940314:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff934586ef4800) 00010000:00010000:2.0:1789127411.940317:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127411.940320:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7400, rc 0) 00000100:00100000:2.0:1789127411.940389:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:10771:x1876035771592064:12345-192.168.206.48@tcp:101:rm.0 Request processed in 374us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127411.940396:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:0.0:1789127411.950213:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127411.950304:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771592320 00000100:00100000:1.0:1789127411.950324:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771592320 00000100:00100000:1.0:1789127411.950376:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:1.0:1789127411.950386:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7388780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:10771:x1876035771592320:12345-192.168.206.48@tcp:101:rm.0 00010000:00010000:1.0:1789127411.950405:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127411.950440:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785d81b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffbcb expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127411.950578:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789127411.950707:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785d81b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbcb expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.950721:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346a69cbe00) 00010000:00010000:1.0:1789127411.950723:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127411.950729:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785d81b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbcb expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127411.950741:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c000, rc 0) 00000100:00100000:1.0:1789127411.950793:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7388780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:10771:x1876035771592320:12345-192.168.206.48@tcp:101:rm.0 Request processed in 408us (593us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1789127411.950799:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:0.0:1789127411.960751:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127411.960849:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771592448 00000100:00100000:1.0:1789127411.960858:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771592448 00000100:00100000:1.0:1789127411.960912:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1789127411.960921:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:10771:x1876035771592448:12345-192.168.206.48@tcp:37:rm.0 00000100:00100000:1.0:1789127411.966020:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:10771:x1876035771592448:12345-192.168.206.48@tcp:37:rm.0 Request processed in 5090us (5269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127411.966033:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:0.0:1789127411.970147:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127411.970290:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771592704 00000100:00100000:2.0:1789127411.970300:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771592704 00000100:00100000:2.0:1789127411.970395:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:2.0:1789127411.970406:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1baac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:10771:x1876035771592704:12345-192.168.206.48@tcp:35:rm.0 00000100:00100000:2.0:1789127411.970797:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1baac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:10771:x1876035771592704:12345-192.168.206.48@tcp:35:rm.0 Request processed in 392us (708us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789127411.970805:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:0.0:1789127411.980225:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127411.981173:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771592960 00000100:00100000:2.0:1789127411.981185:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771592960 00000100:00100000:2.0:1789127411.981302:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:2.0:1789127411.981312:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:10771:x1876035771592960:12345-192.168.206.48@tcp:101:rm.0 00010000:00010000:2.0:1789127411.981334:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127411.981354:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7600/0xd718aadfd785d829 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffbd2 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.981457:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7000/0xd718aadfd785d830 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.981472:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7000/0xd718aadfd785d830 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.981483:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7000/0xd718aadfd785d830 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127411.981494:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789127411.981652:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7600/0xd718aadfd785d829 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbd2 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.981671:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7000/0xd718aadfd785d830 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbd2 expref: 18 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127411.981680:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff934586ef4800) 00010000:00010000:2.0:1789127411.981683:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789127411.981686:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7000, rc 0) 00000100:00100000:2.0:1789127411.981755:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:10771:x1876035771592960:12345-192.168.206.48@tcp:101:rm.0 Request processed in 445us (1539us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789127411.981763:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:0.0:1789127411.985431:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127411.989446:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771593088 00000100:00100000:1.0:1789127411.989526:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771593088 00000100:00100000:1.0:1789127411.989732:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:1.0:1789127411.989857:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:10771:x1876035771593088:12345-192.168.206.48@tcp:41:rm.0 00000004:00000024:1.0:1789127411.989915:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1789127411.990004:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:10771:x1876035771593088:12345-192.168.206.48@tcp:41:rm.0 Request processed in 153us (4592us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127411.990013:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:0.0:1789127411.994752:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127411.994846:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771593216 00000100:00100000:3.0:1789127411.994856:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771593216 00000100:00100000:3.0:1789127411.994908:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:3.0:1789127411.994919:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:10771:x1876035771593216:12345-192.168.206.48@tcp:101:rm.0 00010000:00010000:3.0:1789127411.994937:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127411.994955:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d83e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffbd9 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995013:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d845 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995027:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d845 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995037:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d845 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995047:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d84c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995054:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d84c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995073:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d84c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995226:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785d853 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995236:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785d853 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995244:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785d853 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127411.995282:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789127411.995287:0:9447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127411.995307:0:9447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785d853 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995318:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785d853 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995326:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d845 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995331:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d845 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995337:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d845 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995343:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127411.995346:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d845 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995361:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d845 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995373:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff934586ef4800) 00010000:00010000:3.0:1789127411.995376:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127411.995380:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d845 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995386:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d845 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995401:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d84c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995407:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d84c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995716:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d84c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995722:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0e00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127411.995725:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d84c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995731:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d84c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995741:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff9346a69cb200) 00010000:00010000:3.0:1789127411.995743:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127411.995747:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d84c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995765:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d84c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995793:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d83e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbd9 expref: 20 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995806:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785d853 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbd9 expref: 19 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127411.995814:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9346b6d52e00) 00010000:00010000:3.0:1789127411.995816:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127411.995819:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a1c00, rc 0) 00000100:00100000:0.0:1789127412.004674:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:10771:x1876035771593216:12345-192.168.206.48@tcp:101:rm.0 Request processed in 9745us (9922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127412.004688:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:3.0:1789127412.023665:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692956580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789507840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127412.023740:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127412.023814:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789507840 00000100:00100000:3.0:1789127412.023821:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789507840 00000100:00100000:3.0:1789127412.023866:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789127412.023875:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692954780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789507840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127412.023907:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:3.0:1789127412.023951:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692954780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789507840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127412.023959:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789127412.024002:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692956580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789507840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127412.027247:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127412.027340:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771593472 00000100:00100000:3.0:1789127412.027351:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771593472 00000100:00100000:3.0:1789127412.027427:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:3.0:1789127412.027450:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:10771:x1876035771593472:12345-192.168.206.48@tcp:36:rm.0 00010000:00010000:3.0:1789127412.027497:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789127412.027555:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785d853 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbd9 expref: 19 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.027577:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785d7ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbbd expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.027590:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9346b6d52e00) 00010000:00010000:3.0:1789127412.027601:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7400/0xd718aadfd785d814 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbc4 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.027611:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff934586ef4800) 00010000:00010000:3.0:1789127412.027614:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127412.027635:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d85a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.027648:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d85a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.027657:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d85a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.027668:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d861 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.027676:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d861 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.027682:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d861 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.027794:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d868 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.027803:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d868 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.027810:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d868 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127412.028008:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1789127412.028018:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373220507676ns, next at 374220504803ns, rc = 0 00010000:00010000:3.0:1789127412.028059:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d86f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.028068:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d86f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.028076:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d86f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789127412.028189:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789127412.029422:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d86f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029440:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d86f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029447:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d86f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029537:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127412.029563:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d868 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029582:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d868 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029589:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d868 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029595:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127412.029600:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d868 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029608:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d868 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029621:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9346b6d52e00) 00010000:00010000:3.0:1789127412.029624:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789127412.029629:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d868 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029635:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d868 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029656:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d85a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029663:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d85a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029669:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d85a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029674:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127412.029682:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d85a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029689:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d85a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029697:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff934586ef4800) 00010000:00010000:3.0:1789127412.029699:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127412.029702:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d85a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029708:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1800/0xd718aadfd785d85a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127412.029719:0:6522:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e0fd4eec reply state 0000000074b2e37d transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d861 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029730:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d861 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127412.029737:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff9346a69cb200) 00010000:00010000:3.0:1789127412.029740:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127412.029742:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127412.029826:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:10771:x1876035771593472:12345-192.168.206.48@tcp:36:rm.0 Request processed in 2375us (2585us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789127412.029835:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00010000:00010000:0.0:1789127412.036483:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127412.036495:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d86f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127412.036526:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0a00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127412.036531:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d86f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127412.036563:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d86f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127412.036581:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9346b6d52e00) 00010000:00010000:0.0:1789127412.036584:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789127412.036589:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d86f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127412.036596:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d86f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127412.036610:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127412.036612:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127412.036614:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127412.049949:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127412.050123:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771593728 00000100:00100000:1.0:1789127412.050132:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771593728 00000100:00100000:1.0:1789127412.050199:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1789127412.050209:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:10771:x1876035771593728:12345-192.168.206.48@tcp:35:rm.0 00000100:00100000:1.0:1789127412.050442:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:10771:x1876035771593728:12345-192.168.206.48@tcp:35:rm.0 Request processed in 235us (502us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789127412.050450:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1789127412.054682:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127412.063822:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771593984 00000100:00100000:2.0:1789127412.063837:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771593984 00000100:00100000:2.0:1789127412.063898:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:2.0:1789127412.063910:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:10771:x1876035771593984:12345-192.168.206.48@tcp:36:rm.0 00010000:00010000:2.0:1789127412.063963:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789127412.063997:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7000/0xd718aadfd785d830 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbd2 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064018:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d7ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbaf expref: 18 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064031:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff934586ef4800) 00010000:00010000:2.0:1789127412.064045:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785d78f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffba1 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064071:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346a69cbe00) 00010000:00010000:2.0:1789127412.064078:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127412.064098:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6a00/0xd718aadfd785d876 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064110:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6a00/0xd718aadfd785d876 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064119:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6a00/0xd718aadfd785d876 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064131:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d87d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064137:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d87d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064144:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d87d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064214:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785d884 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064222:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785d884 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064242:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785d884 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127412.064454:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789127412.064468:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785d884 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064481:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785d884 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064487:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785d884 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064493:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6c00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127412.064498:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785d884 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064506:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785d884 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064560:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9346b6d52400) 00010000:00010000:2.0:1789127412.064563:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789127412.064567:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785d884 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064573:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785d884 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064591:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6a00/0xd718aadfd785d876 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064597:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6a00/0xd718aadfd785d876 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064602:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6a00/0xd718aadfd785d876 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064607:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6a00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127412.064615:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6a00/0xd718aadfd785d876 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064622:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6a00/0xd718aadfd785d876 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064629:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346b6d52200) 00010000:00010000:2.0:1789127412.064631:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127412.064634:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6a00/0xd718aadfd785d876 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064640:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6a00/0xd718aadfd785d876 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127412.064651:0:6523:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000aef48794 reply state 00000000fd6c86be transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d87d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064661:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d87d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127412.064668:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9346b6d52000) 00010000:00010000:2.0:1789127412.064671:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789127412.064673:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789127412.064749:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:10771:x1876035771593984:12345-192.168.206.48@tcp:36:rm.0 Request processed in 841us (10074us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789127412.064756:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:0.0:1789127412.535836:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789508096:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127412.536030:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789508224:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127412.536069:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127412.536343:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127412.536438:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789508096 00000100:00100000:1.0:1789127412.536446:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789508096 00000100:00100000:1.0:1789127412.536544:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789127412.536556:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789508096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789127412.536585:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127412.536624:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789508096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127412.536631:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789127412.536755:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789508224 00000100:00100000:2.0:1789127412.536760:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789508224 00000100:00100000:2.0:1789127412.536806:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1789127412.536806:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127412.536819:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789508224:12345-0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1789127412.536837:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587e5f480 x1876035789508096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000004:00000024:2.0:1789127412.536844:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127412.536859:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789508096:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127412.536897:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789508224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127412.536905:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789127412.536989:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789508224:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127412.537798:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587838780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789507968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127412.537846:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127412.538135:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789508736:0@lo:400:kworker.0 00000100:00100000:1.0:1789127412.538192:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127412.538214:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789509248:0@lo:400:kworker.0 00000100:00100000:1.0:1789127412.538240:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127412.538262:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789127412.538268:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789508608:0@lo:400:kworker.0 00000100:00100000:1.0:1789127412.538290:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127412.538305:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789509120:0@lo:400:kworker.0 00000100:00100000:1.0:1789127412.538329:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127412.538351:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789508736 00000100:00100000:1.0:1789127412.538356:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789508736 00000100:00100000:1.0:1789127412.538395:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789509248 00000100:00100000:1.0:1789127412.538398:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789509248 00000100:00100000:1.0:1789127412.538425:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789508608 00000100:00100000:1.0:1789127412.538428:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789508608 00000100:00100000:1.0:1789127412.538443:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789127412.538451:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789508736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127412.538492:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789508736:12345-0@lo:400:kworker.0 Request processed in 42us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127412.538499:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789127412.538706:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789127412.538715:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789509248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127412.538748:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789509248:12345-0@lo:400:kworker.0 Request processed in 35us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127412.538754:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789127412.538776:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789127412.538782:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789508608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127412.538813:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789508608:12345-0@lo:400:kworker.0 Request processed in 31us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127412.538819:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789127412.538848:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789508608:0@lo:400:kworker.0 00000100:00100000:1.0:1789127412.538857:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789508736:0@lo:400:kworker.0 00000100:00100000:1.0:1789127412.538866:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789509248:0@lo:400:kworker.0 00000100:00100000:3.0:1789127412.539028:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789509120 00000100:00100000:3.0:1789127412.539033:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789509120 00000100:00100000:3.0:1789127412.539074:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789127412.539089:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789509120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127412.539141:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e72d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789509120:12345-0@lo:400:kworker.0 Request processed in 54us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127412.539148:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789127412.539179:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789508352:0@lo:400:kworker.0 00000100:00100000:3.0:1789127412.539212:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127412.539233:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789508864:0@lo:400:kworker.0 00000100:00100000:3.0:1789127412.539255:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127412.539270:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789509376:0@lo:400:kworker.0 00000100:00100000:3.0:1789127412.539289:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127412.539303:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789127412.539309:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789508480:0@lo:400:kworker.0 00000100:00100000:3.0:1789127412.539329:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127412.539339:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789508992:0@lo:400:kworker.0 00000100:00100000:3.0:1789127412.539368:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789127412.539404:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587fb2580 x1876035789509120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127412.539427:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789509120:0@lo:400:kworker.0 00000100:00100000:3.0:1789127412.539446:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789508864 00000100:00100000:3.0:1789127412.539449:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789508864 00000100:00100000:3.0:1789127412.539465:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789509376 00000100:00100000:3.0:1789127412.539467:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789509376 00000100:00100000:3.0:1789127412.539476:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789508480 00000100:00100000:3.0:1789127412.539478:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789508480 00000100:00100000:3.0:1789127412.539490:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789127412.539496:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692957840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789508864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127412.539719:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789507968 00000100:00100000:2.0:1789127412.539725:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789507968 00000100:00100000:2.0:1789127412.539759:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789127412.539766:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692956580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789507968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127412.539782:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127412.539820:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692956580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789507968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127412.539826:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789127412.539844:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789508352 00000100:00100000:2.0:1789127412.539847:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789508352 00000100:00100000:2.0:1789127412.539872:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1789127412.539879:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789508352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127412.539911:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789508352:12345-0@lo:400:kworker.0 Request processed in 34us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127412.539917:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1789127412.539949:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789127412.539955:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692957c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789509376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127412.539983:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692957c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789509376:12345-0@lo:400:kworker.0 Request processed in 29us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127412.539990:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789127412.539997:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789508992 00000100:00100000:1.0:1789127412.540003:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789508992 00000100:00100000:2.0:1789127412.540008:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789127412.540016:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789508480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127412.540041:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789127412.540049:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789508480:12345-0@lo:400:kworker.0 Request processed in 33us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127412.540052:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587897c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789508992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127412.540065:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789127412.540095:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587897c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789508992:12345-0@lo:400:kworker.0 Request processed in 46us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127412.540118:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789508480:0@lo:400:kworker.0 00010000:00080000:2.0:1789127412.540130:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345884a0f00 x1876035789508992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127412.540139:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789508992:0@lo:400:kworker.0 00000100:00100000:2.0:1789127412.540148:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789508352:0@lo:400:kworker.0 00010000:00080000:2.0:1789127412.540158:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587fb30c0 x1876035789509376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127412.540165:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789509376:0@lo:400:kworker.0 00000100:00100000:3.0:1789127412.540269:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692957840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789508864:12345-0@lo:400:kworker.0 Request processed in 772us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127412.540276:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789127412.541053:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1789127412.542146:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127412.542165:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127412.542168:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127412.542171:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789127412.542219:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587838780 x1876035789507968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127412.542242:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587838780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789507968:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789127412.542643:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345884a2d00 x1876035789508864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127412.542653:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789508864:0@lo:400:kworker.0 00010000:00010000:3.0:1789127412.664236:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789127413.049217:0:8754:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374241703303ns, next at 375241698921ns, rc = 0 00000100:00100000:2.0:1789127413.049264:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587838780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789509504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127413.049366:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127413.049479:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789509504 00000100:00100000:2.0:1789127413.049488:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789509504 00000100:00100000:2.0:1789127413.049568:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789127413.049579:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789509504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127413.049609:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127413.049663:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789509504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127413.049686:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:2.0:1789127413.049736:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587838780 x1876035789509504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127413.049759:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587838780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789509504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127413.050348:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789509632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127413.050473:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127413.052987:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789509632 00000100:00100000:2.0:1789127413.053007:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789509632 00000100:00100000:2.0:1789127413.053108:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789127413.053121:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587895e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789509632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789127413.053157:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127413.053254:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587895e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789509632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 136us (2781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127413.053263:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1789127413.053734:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587897840 x1876035789509632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127413.053761:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789509632:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789127413.688360:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127414.716184:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127415.305723:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127415.305767:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127415.305802:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127415.305826:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127415.305844:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127415.306295:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127415.306341:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771594496 00000100:00100000:0.0:1789127415.306355:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771594496 00000100:00100000:0.0:1789127415.307101:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:0.0:1789127415.307115:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345860443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771594496:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127415.307375:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771594112 00000100:00100000:3.0:1789127415.307382:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771594112 00000100:00100000:3.0:1789127415.307446:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 401 00000100:00100000:3.0:1789127415.307454:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771594112:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127415.307562:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771594240 00000100:00100000:2.0:1789127415.307568:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771594240 00000100:00100000:2.0:1789127415.307600:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771594752 00000100:00100000:2.0:1789127415.307604:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771594752 00000100:00100000:2.0:1789127415.307619:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771594368 00000100:00100000:2.0:1789127415.307622:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771594368 00000100:00100000:2.0:1789127415.307636:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771594624 00000100:00100000:2.0:1789127415.307639:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771594624 00000100:00100000:2.0:1789127415.307655:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 238 00000100:00100000:2.0:1789127415.307662:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:2402:x1876035771594240:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127415.308053:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345860443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771594496:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 939us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127415.308066:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:0.0:1789127415.308104:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 239 00000100:00100000:0.0:1789127415.308114:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586047c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771594752:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127415.308491:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771594112:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 1034us (2779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127415.308500:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 401 00000100:00100000:2.0:1789127415.308645:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:2402:x1876035771594240:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 982us (2875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127415.308653:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 238 00000100:00100000:2.0:1789127415.308689:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 240 00000100:00100000:2.0:1789127415.308698:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771594368:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127415.308737:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771594368:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 40us (2890us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127415.308744:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 240 00000100:00100000:2.0:1789127415.308758:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 241 00000100:00100000:2.0:1789127415.308767:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771594624:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127415.308791:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771594624:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 27us (2498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127415.308796:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 241 00000100:00100000:0.0:1789127415.308871:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586047c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771594752:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 760us (3044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127415.308879:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 239 00000100:00080000:0.0:1789127415.308911:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127415.308916:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127415.308919:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789127415.736379:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127416.759764:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789127417.132012:0:14386:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1789127417.144889:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789509760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127417.144984:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127417.145073:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789509760 00000100:00100000:1.0:1789127417.145082:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789509760 00000100:00100000:1.0:1789127417.145139:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789127417.145150:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789509760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127417.145195:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789127417.145259:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789509760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127417.145268:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789127417.147082:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789509760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127417.656039:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aeca7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789510272:0@lo:400:kworker.0 00000100:00100000:2.0:1789127417.656142:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127417.656215:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789510784:0@lo:400:kworker.0 00000100:00100000:2.0:1789127417.656248:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127417.656270:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789511296:0@lo:400:kworker.0 00000100:00100000:2.0:1789127417.656294:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127417.656321:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789127417.656327:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587838780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789510144:0@lo:400:kworker.0 00000100:00100000:2.0:1789127417.656351:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127417.656369:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789510656:0@lo:400:kworker.0 00000100:00100000:2.0:1789127417.656404:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127417.656421:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789511168:0@lo:400:kworker.0 00000100:00100000:1.0:1789127417.656611:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789510784 00000100:00100000:1.0:1789127417.656620:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789510784 00000100:00100000:1.0:1789127417.656683:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789511296 00000100:00100000:1.0:1789127417.656686:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789511296 00000100:00100000:1.0:1789127417.656707:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789127417.656717:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789510784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127417.656779:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812a8780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789510784:12345-0@lo:400:kworker.0 Request processed in 63us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127417.656787:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789127417.656806:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789127417.656812:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789511296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127417.656840:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789511296:12345-0@lo:400:kworker.0 Request processed in 29us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127417.656845:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789127417.656879:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789510272 00000100:00100000:1.0:1789127417.656882:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789510272 00000100:00100000:1.0:1789127417.656903:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789510144 00000100:00100000:1.0:1789127417.656905:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789510144 00000100:00100000:1.0:1789127417.656914:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789510656 00000100:00100000:1.0:1789127417.656916:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789510656 00000100:00100000:1.0:1789127417.656929:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789127417.656934:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789510272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127417.656963:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789510272:12345-0@lo:400:kworker.0 Request processed in 28us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127417.656968:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789127417.656978:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789127417.656983:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789510144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127417.657008:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789510144:12345-0@lo:400:kworker.0 Request processed in 25us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127417.657139:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127417.657182:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aeca7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789510272:0@lo:400:kworker.0 00010000:00080000:2.0:1789127417.657196:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346812ab840 x1876035789510784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127417.657206:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789510784:0@lo:400:kworker.0 00010000:00080000:2.0:1789127417.657216:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346812aad00 x1876035789511296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127417.657223:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789511296:0@lo:400:kworker.0 00000100:00100000:2.0:1789127417.657248:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587838780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789510144:0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.657397:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345884a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789510016:0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.657449:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127417.657483:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789510528:0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.657540:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127417.657554:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789511040:0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.657578:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127417.657593:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1789127417.657600:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789509888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127417.657626:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127417.657647:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789510400:0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.657667:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127417.657682:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812a9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789510912:0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.657703:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127417.657719:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789511424:0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.657741:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127417.657771:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789511168 00000100:00100000:0.0:1789127417.657776:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789511168 00000100:00100000:0.0:1789127417.657811:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789510528 00000100:00100000:0.0:1789127417.657814:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789510528 00000100:00100000:0.0:1789127417.657827:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789511040 00000100:00100000:0.0:1789127417.657829:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789511040 00000100:00100000:0.0:1789127417.657845:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789127417.657853:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789510656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.657901:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789510656:12345-0@lo:400:kworker.0 Request processed in 48us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127417.657908:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789127417.657922:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789127417.657929:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789511168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.657958:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789511168:12345-0@lo:400:kworker.0 Request processed in 30us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127417.657971:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789127417.657986:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789127417.657992:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789510528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.658042:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789510528:12345-0@lo:400:kworker.0 Request processed in 50us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127417.658047:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789127417.658060:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789127417.658066:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789511040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.658111:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789511040:12345-0@lo:400:kworker.0 Request processed in 46us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127417.658118:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:0.0:1789127417.658144:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127417.658149:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127417.658152:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127417.658155:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127417.658166:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789510912 00000100:00100000:0.0:1789127417.658170:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789510912 00000100:00100000:0.0:1789127417.658198:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789511424 00000100:00100000:0.0:1789127417.658202:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789511424 00000100:00100000:0.0:1789127417.658218:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789127417.658224:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789510912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.658257:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789510912:12345-0@lo:400:kworker.0 Request processed in 33us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127417.658264:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789127417.658276:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789127417.658282:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789511424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.658322:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789511424:12345-0@lo:400:kworker.0 Request processed in 41us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127417.658329:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789127417.658408:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789510016 00000100:00100000:0.0:1789127417.658411:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789510016 00000100:00100000:0.0:1789127417.658442:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1789127417.658448:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789510016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.658479:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789510016:12345-0@lo:400:kworker.0 Request processed in 32us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127417.658485:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1789127417.658544:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789509888 00000100:00100000:0.0:1789127417.658548:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789509888 00000100:00100000:0.0:1789127417.658572:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789510400 00000100:00100000:0.0:1789127417.658575:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789510400 00000100:00100000:0.0:1789127417.658588:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789127417.658594:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789509888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789127417.658624:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127417.658662:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789509888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127417.658668:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1789127417.658679:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789127417.658685:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789510400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.658712:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72aa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789510400:12345-0@lo:400:kworker.0 Request processed in 28us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127417.658718:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1789127417.658742:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127417.658752:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127417.658776:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789511552:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127417.658809:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127417.658854:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789509888:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127417.658865:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789510400:0@lo:400:kworker.0 00010000:00080000:0.0:1789127417.658879:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346812a9e00 x1876035789510912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127417.658889:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812a9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789510912:0@lo:400:kworker.0 00010000:00080000:0.0:1789127417.658899:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346812a8f00 x1876035789511424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127417.658907:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789511424:0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.658916:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345884a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789510016:0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.658929:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812aa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789510528:0@lo:400:kworker.0 00000100:00100000:0.0:1789127417.658940:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789511040:0@lo:400:kworker.0 00010000:00080000:0.0:1789127417.658994:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346812abc00 x1876035789510656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127417.659004:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789510656:0@lo:400:kworker.0 00010000:00080000:0.0:1789127417.659015:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346812a9680 x1876035789511168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127417.659024:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812a9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789511168:0@lo:400:kworker.0 00000100:00100000:1.0:1789127417.659539:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789127417.659588:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789511552 00000100:00100000:1.0:1789127417.659594:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789511552 00000100:00100000:1.0:1789127417.659630:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789127417.659638:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789511552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789127417.659664:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127417.659720:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789511552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127417.659726:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:1.0:1789127417.659764:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b72a8f00 x1876035789511552/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127417.659780:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789511552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127417.659808:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127417.659819:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789511680:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127417.659850:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127417.659879:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789511680 00000100:00100000:1.0:1789127417.659883:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789511680 00000100:00100000:1.0:1789127417.659903:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789127417.659909:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e72580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789511680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789127417.659919:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127417.659950:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e72580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789511680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127417.659956:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:1.0:1789127417.659980:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346812aad00 x1876035789511680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127417.660007:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789511680:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1789127417.666655:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1789127417.666706:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1789127417.666721:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1789127417.666812:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7e3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.666827:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7e3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.666835:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.666860:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127417.666866:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7e3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.666875:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7e3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.666896:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff9346a69cb200) 00010000:00010000:3.0:1789127417.666900:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127417.666905:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7e3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.666912:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785d7e3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.666937:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d7f8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.666944:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d7f8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.666950:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d7f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.666954:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127417.666957:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d7f8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.666963:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d7f8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.666985:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9346b6d52e00) 00010000:00010000:3.0:1789127417.666988:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127417.666992:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d7f8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.666998:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d7f8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.667019:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d861 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.667037:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d861 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.667043:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d861 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.667048:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0e00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127417.667051:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d861 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.667056:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d861 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.667064:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6a3bfed6 (ffff9346a69cb200) 00010000:00010000:3.0:1789127417.667067:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127417.667069:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d861 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.667076:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0e00/0xd718aadfd785d861 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6a3bfed6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.667103:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d87d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.667110:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d87d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.667117:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d87d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.667122:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127417.667126:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d87d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.667131:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d87d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.667138:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9346b6d52000) 00010000:00010000:3.0:1789127417.667141:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127417.667144:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d87d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.667149:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d87d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127417.667466:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789511808:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789127417.667608:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127417.667937:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789511808 00000100:00100000:0.0:1789127417.667956:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789511808 00000100:00100000:0.0:1789127417.668019:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789127417.668151:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346bf8b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789511808:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789127417.668186:0:10363:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1789127417.668227:0:10363:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa3eaf2, atime: 0x6aa3eaf2, ctime: 0x6aa3eaf2, blocks: 0x0 00010000:00010000:0.0:1789127417.668236:0:10363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a619041/0xd718aadfd785d88b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127417.668255:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1789127417.668260:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127417.668268:0:10363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a619041/0xd718aadfd785d88b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127417.668287:0:10363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a619041/0xd718aadfd785d88b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127417.668297:0:10363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a619041/0xd718aadfd785d88b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127417.668305:0:10363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a619041/0xd718aadfd785d88b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127417.668335:0:10363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789127417.668610:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346bf8b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789511808:12345-0@lo:6:osp-syn-0-0.0 Request processed in 462us (1000us total) trans 4294967301 rc 0/0 00010000:00010000:3.0:1789127417.668671:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127417.668679:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a619041/0xd718aadfd785d88b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.668689:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed800 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127417.668694:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a619041/0xd718aadfd785d88b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.668714:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a619041/0xd718aadfd785d88b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.668735:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a619041/0xd718aadfd785d88b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.668742:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a619041/0xd718aadfd785d88b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127417.668762:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127417.668764:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127417.668765:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789127417.668826:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9346b72aa1c0/2, rc 0, transno 4294967301 00000100:00100000:3.0:1789127417.668833:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789511808:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789127417.699148:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1789127417.793856:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127418.167843:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127418.167872:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789511936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127418.167962:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127418.168036:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789511936 00000100:00100000:1.0:1789127418.168045:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789511936 00000100:00100000:1.0:1789127418.168096:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789127418.168107:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789511936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127418.168145:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127418.168198:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789511936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127418.168207:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789127418.168264:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789511936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127418.170929:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127418.170959:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789512064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127418.171044:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127418.171648:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789512064 00000100:00100000:0.0:1789127418.171666:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789512064 00000100:00100000:0.0:1789127418.171726:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789127418.171737:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789512064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789127418.171770:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127418.171837:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789512064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127418.171846:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789127418.171906:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812ab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789512064:0@lo:13:osp-pre-0-1.0 00000020:00000080:0.0:1789127418.535284:0:14434:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3ecf02a0 20000000:00000080:0.0:1789127418.535306:0:14434:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9346812eb800 uarg=0000000000000000 20000000:01000000:0.0:1789127418.535363:0:14434:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789127418.535372:0:14434:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789127418.535391:0:14434:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1789127418.537002:0:14435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 20000000:02000000:2.0:1789127418.538487:0:14434:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789127418.551989:0:14434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 224 off10720 00000040:00080000:2.0:1789127418.552023:0:14434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 128 off10848 00000040:00080000:2.0:1789127418.552039:0:14434:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off11072 10000000:01000000:2.0:1789127418.552054:0:14434:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789127418.552073:0:14434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.552090:0:14434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d71f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d718 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.552099:0:14434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928fe600/0xd718aadfd785d72d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d726 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.552124:0:14434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928ff400/0xd718aadfd785d73b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d734 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.552130:0:14434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93458858d800/0xd718aadfd785d749 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d742 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.552140:0:14434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346928ff600/0xd718aadfd785d750 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb8c expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.552147:0:14434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff934587fec400/0xd718aadfd785d757 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb93 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.552156:0:14434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.552196:0:14434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff934587fec400/0xd718aadfd785d757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb93 expref: 12 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.552210:0:14434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff934587fec400/0xd718aadfd785d757 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb93 expref: 12 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127418.552224:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812aa1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14434:1876035789512192:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127418.553060:0:14434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928ff600/0xd718aadfd785d750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb8c expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553072:0:14434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9346928ff600/0xd718aadfd785d750 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb8c expref: 12 pid: 6516 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127418.553088:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812ab840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14434:1876035789512320:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127418.553191:0:14434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93458858d800/0xd718aadfd785d749 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d742 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553200:0:14434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff93458858d800/0xd718aadfd785d749 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d742 expref: 23 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127418.553215:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812a8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14434:1876035789512448:0@lo:104: 00000100:00100000:2.0:1789127418.553253:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127418.553279:0:14434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928ff400/0xd718aadfd785d73b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d734 expref: 23 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553287:0:14434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928ff400/0xd718aadfd785d73b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d734 expref: 23 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127418.553306:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812aad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14434:1876035789512576:0@lo:104: 00000100:00100000:2.0:1789127418.553330:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127418.553359:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789512448 00000100:00100000:2.0:1789127418.553385:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789512448 00000100:00100000:2.0:1789127418.553426:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789512576 00000100:00100000:2.0:1789127418.553430:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789512576 00000100:00100000:2.0:1789127418.553451:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789127418.553458:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:14434:x1876035789512448:12345-0@lo:104: 00010000:00010000:2.0:1789127418.553471:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d749 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553532:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789127418.553538:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+4:14434:x1876035789512448:12345-0@lo:104: Request processed in 81us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127418.553544:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789127418.553567:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789127418.553573:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812a9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:14434:x1876035789512576:12345-0@lo:104: 00010000:00010000:2.0:1789127418.553580:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d73b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553613:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789127418.553617:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812a9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:14434:x1876035789512576:12345-0@lo:104: Request processed in 45us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127418.553624:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:2.0:1789127418.553643:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127418.553649:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d749 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553656:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe800 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127418.553660:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d749 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553668:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d749 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127418.553676:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d749 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127418.553682:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789127418.553707:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d749 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553713:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127418.553731:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d749 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553748:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928fe800/0xd718aadfd785d742 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d749 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553761:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127418.553764:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d73b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553770:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec600 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127418.553773:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d73b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553781:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d73b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127418.553787:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d73b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127418.553792:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789127418.553807:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d73b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553813:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127418.553820:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d73b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553827:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934587fec600/0xd718aadfd785d734 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d73b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.553836:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127418.553844:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127418.553847:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127418.553862:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789512704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127418.553893:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127418.553926:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127418.553935:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789512832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127418.553963:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127418.553998:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127418.554004:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789512704 00000100:00100000:2.0:1789127418.554011:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789512704 00010000:00010000:2.0:1789127418.554034:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93458858d800/0xd718aadfd785d749 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d742 expref: 24 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127418.554056:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789512832 00000100:00100000:2.0:1789127418.554059:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789512832 00010000:00010000:2.0:1789127418.554072:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928ff400/0xd718aadfd785d73b lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d734 expref: 25 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127418.554088:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789127418.554095:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812aa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+25:3650:x1876035789512704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789127418.554105:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127418.554110:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93458858d800/0xd718aadfd785d749 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d742 expref: 25 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.554119:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93458858d800/0xd718aadfd785d749 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d742 expref: 25 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.554136:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127418.554161:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789127418.554175:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812aa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+25:3650:x1876035789512704:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127418.554185:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9de9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+25:3650:x1876035789512832:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127418.554194:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1789127418.554212:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127418.554223:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928ff400/0xd718aadfd785d73b lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d734 expref: 24 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.554238:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928ff400/0xd718aadfd785d73b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d734 expref: 24 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127418.554250:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789512704:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127418.554260:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127418.554298:0:14434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928fe600/0xd718aadfd785d72d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d726 expref: 24 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.554311:0:14434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928fe600/0xd718aadfd785d72d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d726 expref: 24 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127418.554322:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812abc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14434:1876035789512960:0@lo:104: 00000100:00100000:3.0:1789127418.554355:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9de9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789512832:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127418.554384:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789127418.554489:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789512832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127418.555393:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127418.558838:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789512960 00000100:00100000:3.0:1789127418.558853:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789512960 00000100:00100000:3.0:1789127418.558914:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789127418.558924:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:14434:x1876035789512960:12345-0@lo:104: 00010000:00010000:3.0:1789127418.558940:0:6505:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d72d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.559037:0:6505:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127418.559043:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:14434:x1876035789512960:12345-0@lo:104: Request processed in 121us (3653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127418.559050:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1789127418.559110:0:14434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785d718 expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.559123:0:14434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d71f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785d718 expref: 23 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127418.559135:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14434:1876035789513088:0@lo:104: 00000100:00100000:3.0:1789127418.559169:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127418.559190:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec7d540 going to sleep for 11 seconds 00010000:00010000:3.0:1789127418.559212:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93458858d800/0xd718aadfd785d749 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d742 expref: 23 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127418.559227:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812a8780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14434:1876035789512448:0@lo:104: 00010000:00010000:3.0:1789127418.559238:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928ff400/0xd718aadfd785d73b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d734 expref: 22 pid: 6517 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127418.559262:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812aad00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14434:1876035789512576:0@lo:104: 00000100:00100000:3.0:1789127418.559273:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812abc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14434:1876035789512960:0@lo:104: 00010000:00010000:1.0:1789127418.559759:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127418.559767:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d72d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.559775:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858da00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127418.559779:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d72d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.559788:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d72d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127418.559807:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d72d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127418.559813:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127418.559848:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d72d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.559855:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127418.559879:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d72d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.559886:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93458858da00/0xd718aadfd785d726 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d72d expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.559897:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127418.559899:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127418.559901:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127418.559913:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789513216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127418.559949:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127418.559998:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789513216 00000100:00100000:1.0:1789127418.560003:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789513216 00010000:00010000:1.0:1789127418.560024:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928fe600/0xd718aadfd785d72d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d726 expref: 22 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127418.560049:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789127418.560056:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:3652:x1876035789513216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127418.560067:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127418.560072:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928fe600/0xd718aadfd785d72d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d726 expref: 22 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.560087:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928fe600/0xd718aadfd785d72d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d726 expref: 22 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.560101:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928fe600/0xd718aadfd785d72d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d726 expref: 22 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.560113:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127418.560145:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3652:x1876035789513216:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127418.560151:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789127418.560173:0:9528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789513088 00000100:00100000:1.0:1789127418.560177:0:9528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789513088 00000100:00100000:1.0:1789127418.560200:0:9528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789127418.560206:0:9528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587896d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:14434:x1876035789513088:12345-0@lo:104: 00010000:00010000:1.0:1789127418.560216:0:9528:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d71f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.560255:0:9528:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127418.560260:0:9528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587896d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+3:14434:x1876035789513088:12345-0@lo:104: Request processed in 55us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127418.560266:0:9528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:1.0:1789127418.560281:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127418.560285:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785d71f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.560360:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587feda00 already unused, calling callback (ffffffffc146dc20) 00000100:00100000:2.0:1789127418.560495:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14434:1876035789513088:0@lo:104: 10000000:00010000:1.0:1789127418.560648:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785d71f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.560667:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785d71f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127418.560673:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785d71f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127418.560678:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127418.560706:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d71f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.560713:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127418.560723:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d71f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.560730:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785d718 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785d71f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.560742:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127418.560743:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127418.560745:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127418.560754:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789513344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127418.560781:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127418.560827:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e730c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789513216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127418.562803:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789513344 00000100:00100000:3.0:1789127418.562815:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789513344 00010000:00010000:3.0:1789127418.562852:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d71f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d718 expref: 21 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127418.563002:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789127418.563012:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e72940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3653:x1876035789513344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127418.563026:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127418.563031:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d71f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785d718 expref: 21 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.563041:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d71f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785d718 expref: 21 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.563067:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928ffa00/0xd718aadfd785d71f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785d718 expref: 21 pid: 6514 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127418.563081:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127418.563146:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e72940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:3653:x1876035789513344:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127418.563155:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127418.563226:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789513344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127418.566067:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812aa1c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14434:1876035789512192:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127418.566083:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812ab840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14434:1876035789512320:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127418.566115:0:14434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127418.580269:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127418.580372:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127418.580480:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771594880 00000100:00100000:2.0:1789127418.580489:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771594880 00010000:00010000:2.0:1789127418.580560:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff934587fec400/0xd718aadfd785d757 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb93 expref: 13 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127418.580591:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771595008 00000100:00100000:2.0:1789127418.580594:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771595008 00010000:00010000:2.0:1789127418.580606:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346928ff600/0xd718aadfd785d750 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb8c expref: 14 pid: 6516 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127418.580623:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:2.0:1789127418.580632:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+14:2401:x1876035771594880:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127418.580644:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127418.580650:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff934587fec400/0xd718aadfd785d757 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb93 expref: 14 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127418.580658:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00010000:00010000:2.0:1789127418.580661:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff934587fec400/0xd718aadfd785d757 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb93 expref: 14 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127418.580666:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e73c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+14:2402:x1876035771595008:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127418.580673:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127418.580677:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346928ff600/0xd718aadfd785d750 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb8c expref: 14 pid: 6516 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127418.580689:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587fec400/0xd718aadfd785d757 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb93 expref: 14 pid: 6514 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127418.582744:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346928ff600/0xd718aadfd785d750 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb8c expref: 13 pid: 6516 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127418.582771:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928ff600/0xd718aadfd785d750 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb8c expref: 13 pid: 6516 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127418.582788:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127418.582813:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127418.582836:0:6509:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127418.582843:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127418.582850:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127418.582856:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127418.582862:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127418.582869:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127418.582877:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127418.582892:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.582945:0:14434:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.582965:0:14434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127418.582971:0:14434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9345886d6600/0xd718aadfd785d892 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127418.582993:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127418.583058:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e73c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:2402:x1876035771595008:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 2391us (2685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127418.583068:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00010000:00010000:2.0:1789127418.584028:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127418.584085:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e730c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:2401:x1876035771594880:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 3451us (3822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127418.584094:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00010000:00010000:2.0:1789127418.808629:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789127419.520784:0:14483:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffceef3e730 20000000:00000080:3.0:1789127419.520801:0:14483:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff934588412000 uarg=0000000000000000 20000000:01000000:3.0:1789127419.520846:0:14483:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789127419.520852:0:14483:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:3.0:1789127419.520857:0:14483:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:2.0:1789127419.528761:0:14484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 16 count 16 20000000:02000000:3.0:1789127419.528933:0:14483:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:3.0:1789127419.529021:0:14483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11296 00000040:00080000:3.0:1789127419.529059:0:14483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 128 off11424 00000040:00080000:3.0:1789127419.529076:0:14483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11648 10000000:01000000:3.0:1789127419.529087:0:14483:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789127419.529107:0:14483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d899 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127419.529122:0:14483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d899 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127419.529131:0:14483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d899 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127419.529138:0:14483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d899 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127419.529144:0:14483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d899 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127419.529151:0:14483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d899 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127419.529157:0:14483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0e00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127419.529160:0:14483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d899 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127419.529180:0:14483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d899 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127419.529192:0:14483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d899 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127419.529199:0:14483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d899 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127419.529205:0:14483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d899 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127419.831921:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127420.032252:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127420.032541:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771595136 00000100:00100000:2.0:1789127420.032551:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771595136 00000100:00100000:2.0:1789127420.032596:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 403 00000100:00100000:2.0:1789127420.032604:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:6173:x1876035771595136:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127420.032619:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127420.032636:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9345886d6400/0xd718aadfd785d8a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffbe0 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127420.032661:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d6400/0xd718aadfd785d8a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbe0 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127420.032671:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9345886d6400/0xd718aadfd785d8a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbe0 expref: 12 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127420.032692:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6400, rc 0) 00000100:00100000:2.0:1789127420.032749:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771595136:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 144us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.032756:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 403 00000100:00100000:0.0:1789127420.038198:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127420.038393:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771595264 00000100:00100000:1.0:1789127420.038403:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771595264 00000100:00100000:1.0:1789127420.038460:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 404 00000100:00100000:1.0:1789127420.038470:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771595264:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127420.038643:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771595264:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 174us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127420.038651:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 404 00000100:00100000:1.0:1789127420.041847:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127420.041937:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771595392 00000100:00100000:0.0:1789127420.041947:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771595392 00000100:00100000:0.0:1789127420.041999:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 405 00000100:00100000:0.0:1789127420.042074:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771595392:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127420.042359:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771595392:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 351us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127420.042375:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 405 00000100:00100000:0.0:1789127420.049923:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127420.050039:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771595520 00000100:00100000:2.0:1789127420.050049:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771595520 00000100:00100000:2.0:1789127420.050156:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 406 00000100:00100000:2.0:1789127420.050166:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:11056:x1876035771595520:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127420.050301:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:11056:x1876035771595520:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 136us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.050310:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 406 00000100:00100000:2.0:1789127420.073668:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127420.073712:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771595648 00000100:00100000:1.0:1789127420.073722:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771595648 00000100:00100000:1.0:1789127420.073780:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 407 00000100:00100000:1.0:1789127420.073789:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:11056:x1876035771595648:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127420.073928:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:11056:x1876035771595648:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 139us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127420.073935:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 407 00000100:00100000:0.0:1789127420.081258:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127420.081663:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771595776 00000100:00100000:2.0:1789127420.081672:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771595776 00000100:00100000:2.0:1789127420.081727:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 408 00000100:00100000:2.0:1789127420.081736:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:6173:x1876035771595776:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127420.081753:0:6517:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127420.081769:0:6517:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9345886d7000/0xd718aadfd785d8a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffbe7 expref: -99 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127420.081795:0:6517:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d7000/0xd718aadfd785d8a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbe7 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127420.081806:0:6517:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9345886d7000/0xd718aadfd785d8a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbe7 expref: 13 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127420.081815:0:6517:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7000, rc 0) 00000100:00100000:2.0:1789127420.081874:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1842050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771595776:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 138us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.081881:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 408 00000100:00100000:2.0:1789127420.084574:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127420.084670:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771595904 00000100:00100000:3.0:1789127420.085443:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771595904 00000100:00100000:3.0:1789127420.085503:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 409 00000100:00100000:3.0:1789127420.085539:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771595904:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127420.085678:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771595904:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 166us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127420.085686:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 409 00000100:00100000:0.0:1789127420.087570:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127420.087698:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771596032 00000100:00100000:1.0:1789127420.087706:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771596032 00000100:00100000:1.0:1789127420.087753:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 410 00000100:00100000:1.0:1789127420.087777:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771596032:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127420.087895:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:6173:x1876035771596032:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 118us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127420.087903:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 410 00000100:00100000:0.0:1789127420.093458:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127420.093888:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771596160 00000100:00100000:2.0:1789127420.093898:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771596160 00000100:00100000:2.0:1789127420.093954:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 411 00000100:00100000:2.0:1789127420.093964:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:11059:x1876035771596160:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127420.094125:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:11059:x1876035771596160:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 160us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.094133:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 411 00000100:00100000:2.0:1789127420.096724:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127420.097107:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771596288 00000100:00100000:3.0:1789127420.097119:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771596288 00000100:00100000:3.0:1789127420.097176:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 412 00000100:00100000:3.0:1789127420.097187:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:11059:x1876035771596288:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789127420.097411:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:11059:x1876035771596288:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 226us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127420.097419:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 412 10000000:01000000:2.0:1789127420.345287:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127420.345296:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934586ebc000 from 13 10000000:01000000:2.0:1789127420.345301:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127420.345352:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127420.345364:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127420.345385:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127420.345412:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812a92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789513472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127420.345478:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127420.345574:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127420.345942:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789513472 00000100:00100000:1.0:1789127420.345949:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789513472 00000100:00100000:1.0:1789127420.346000:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1789127420.346009:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:6520:x1876035789513472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127420.346021:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127420.346034:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93458858d400/0xd718aadfd785d8b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d8ae expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127420.346055:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93458858d400/0xd718aadfd785d8b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d8ae expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127420.346065:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93458858d400/0xd718aadfd785d8b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d8ae expref: 21 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127420.346073:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858d400, rc 0) 00000100:00100000:1.0:1789127420.346122:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789513472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127420.346128:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1789127420.346215:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812a92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789513472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127420.346230:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127420.346239:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127420.346298:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789513600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127420.346327:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127420.346349:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec3ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127420.346686:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789513600 00000100:00100000:1.0:1789127420.346691:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789513600 00000100:00100000:1.0:1789127420.346728:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1789127420.346744:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789513600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127420.346984:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789513600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127420.347005:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1789127420.347085:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789513600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127420.347126:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789513728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127420.347165:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127420.347196:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec3ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127420.347244:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789513728 00000100:00100000:0.0:1789127420.347249:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789513728 00000100:00100000:0.0:1789127420.347280:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1789127420.347287:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789513728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127420.347384:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789513728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127420.347391:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:3.0:1789127420.347609:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789513728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127420.350234:0:14496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14496:1876035789513856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127420.350313:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127420.350357:0:14496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec3acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127420.350424:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789513856 00000100:00100000:0.0:1789127420.350431:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789513856 00000100:00100000:0.0:1789127420.350476:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:0.0:1789127420.350485:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:14496:x1876035789513856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127420.350635:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:14496:x1876035789513856:12345-0@lo:502:llog_process_th.0 Request processed in 150us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127420.350644:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1789127420.350793:0:14496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14496:1876035789513856:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127420.350820:0:14496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127420.350828:0:14496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127420.350830:0:14496:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789127420.350836:0:14496:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff934586ebc000 00000020:00000080:3.0:1789127420.350839:0:14496:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127420.350893:0:14496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127420.350903:0:14496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127420.350904:0:14496:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789127420.350907:0:14496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127420.350910:0:14496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127420.350912:0:14496:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789127420.350915:0:14496:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff934586ebc000 00000020:00000080:3.0:1789127420.350917:0:14496:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789127420.350952:0:14496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14496:1876035789513984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127420.350984:0:14496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127420.351011:0:14496:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec3acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127420.352995:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789513984 00000100:00100000:2.0:1789127420.353007:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789513984 00000100:00100000:2.0:1789127420.353059:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1789127420.353068:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:14496:x1876035789513984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127420.353196:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:14496:x1876035789513984:12345-0@lo:502:llog_process_th.0 Request processed in 128us (2211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.353210:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1789127420.356068:0:14496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14496:1876035789513984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127420.356110:0:14496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127420.356118:0:14496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127420.356121:0:14496:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789127420.356125:0:14496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:1.0:1789127420.356293:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:1.0:1789127420.356316:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127420.356326:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127420.356336:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127420.356345:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789127420.356348:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b6688800 from 13 10000000:01000000:1.0:1789127420.356350:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789127420.356391:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127420.356399:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127420.356408:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127420.356430:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e73840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789514112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127420.356485:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127420.356562:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934588439900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127420.357529:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789514112 00000100:00100000:3.0:1789127420.357538:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789514112 00000100:00100000:3.0:1789127420.357596:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:3.0:1789127420.357606:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:6520:x1876035789514112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127420.357620:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127420.357635:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d8c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d8bc expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127420.357659:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d8c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d8bc expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127420.357670:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d8c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d8bc expref: 22 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127420.357678:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a0e00, rc 0) 00000100:00100000:1.0:1789127420.358994:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e73840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789514112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127420.359014:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127420.359025:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d8c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127420.359105:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e73840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789514240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127420.363082:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127420.363198:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934588439900 going to sleep for 11 seconds 00000100:00100000:1.0:1789127420.363227:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789514240 00000100:00100000:1.0:1789127420.363234:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789514240 00000100:00100000:1.0:1789127420.363278:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1789127420.363288:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789514240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127420.363426:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789514240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 139us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127420.363434:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1789127420.364268:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e73840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789514240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127420.364318:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e73840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789514368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127420.364381:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127420.364412:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff934588439900 going to sleep for 11 seconds 00000100:00100000:1.0:1789127420.364431:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789514368 00000100:00100000:1.0:1789127420.364436:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789514368 00000100:00100000:3.0:1789127420.364592:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789514112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 6986us (8104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127420.364615:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:1.0:1789127420.364628:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789514368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127420.364714:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789514368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.365943:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e73840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789514368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127420.366146:0:14499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812a92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14499:1876035789514496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127420.366200:0:14499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127420.366228:0:6517:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 3 min 3 max 32 00000100:00100000:2.0:1789127420.366234:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0003' 00000100:00100000:2.0:1789127420.366320:0:14499:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698a61d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127420.366345:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789514496 00000100:00100000:2.0:1789127420.366350:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789514496 00000100:00100000:2.0:1789127420.366438:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1789127420.366447:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:14499:x1876035789514496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127420.366560:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:14499:x1876035789514496:12345-0@lo:502:llog_process_th.0 Request processed in 114us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.366568:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1789127420.366604:0:14499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812a92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14499:1876035789514496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127420.366628:0:14499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127420.366637:0:14499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127420.366639:0:14499:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789127420.366648:0:14499:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b6688800 00000020:00000080:2.0:1789127420.366650:0:14499:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789127420.366710:0:14499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127420.366714:0:14499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127420.366715:0:14499:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789127420.366718:0:14499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127420.366720:0:14499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127420.366722:0:14499:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789127420.366725:0:14499:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b6688800 00000020:00000080:2.0:1789127420.366734:0:14499:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789127420.366770:0:14499:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812a92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14499:1876035789514624:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127420.366803:0:14499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127420.367680:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789514624 00000100:00100000:2.0:1789127420.367688:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789514624 00000100:00100000:2.0:1789127420.367716:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1789127420.367724:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:14499:x1876035789514624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127420.367828:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:14499:x1876035789514624:12345-0@lo:502:llog_process_th.0 Request processed in 87us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.367837:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1789127420.368020:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1789127420.368030:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1789127420.368791:0:14499:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127420.368817:0:14499:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812a92c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14499:1876035789514624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789127420.368847:0:14499:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127420.368853:0:14499:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127420.368856:0:14499:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789127420.368862:0:14499:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:3.0:1789127420.369261:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:3.0:1789127420.369285:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789127420.369295:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127420.369306:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127420.369317:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789127420.369320:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b640b000 from 13 10000000:01000000:3.0:1789127420.369322:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127420.369352:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127420.369359:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127420.369377:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127420.369398:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789514752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127420.369446:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127420.369479:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec3a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127420.370196:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789514752 00000100:00100000:2.0:1789127420.370203:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789514752 00000100:00100000:2.0:1789127420.370254:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1789127420.370264:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:6520:x1876035789514752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127420.370285:0:6514:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127420.370299:0:6514:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9345886d7400/0xd718aadfd785d8d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d8ca expref: -99 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127420.370320:0:6514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d7400/0xd718aadfd785d8d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d8ca expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127420.370329:0:6514:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9345886d7400/0xd718aadfd785d8d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d8ca expref: 23 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127420.370345:0:6514:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7400, rc 0) 00000100:00100000:2.0:1789127420.370406:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789514752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.370413:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1789127420.370490:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789514752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127420.370504:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127420.370550:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127420.370616:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789514880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127420.370645:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127420.370672:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec3a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127420.370724:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789514880 00000100:00100000:1.0:1789127420.370728:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789514880 00000100:00100000:1.0:1789127420.370760:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1789127420.370774:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789514880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127420.370894:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789514880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127420.370901:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1789127420.371026:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789514880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789127420.371052:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789515008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127420.371086:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127420.371113:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec3a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127420.371125:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789515008 00000100:00100000:3.0:1789127420.371128:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789515008 00000100:00100000:3.0:1789127420.371148:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1789127420.371154:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789515008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127420.371220:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789515008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127420.371226:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1789127420.371262:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789515008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789127420.371434:0:14501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14501:1876035789515136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127420.371469:0:14501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127420.371486:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789515136 00000100:00100000:3.0:1789127420.371489:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789515136 00000100:00100000:3.0:1789127420.371506:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1789127420.371531:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:14501:x1876035789515136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127420.371608:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:14501:x1876035789515136:12345-0@lo:502:llog_process_th.0 Request processed in 77us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127420.371615:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:3.0:1789127420.371642:0:14501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec3a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127420.371653:0:14501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14501:1876035789515136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127420.371672:0:14501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127420.371681:0:14501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127420.371683:0:14501:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789127420.371689:0:14501:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b640b000 00000020:00000080:3.0:1789127420.371691:0:14501:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789127420.373060:0:14501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127420.373072:0:14501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127420.373074:0:14501:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789127420.373078:0:14501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127420.373081:0:14501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127420.373083:0:14501:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789127420.373086:0:14501:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b640b000 00000020:00000080:3.0:1789127420.373088:0:14501:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789127420.373155:0:14501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14501:1876035789515264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127420.373218:0:14501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127420.373261:0:14501:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec3a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127420.374333:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789515264 00000100:00100000:2.0:1789127420.374343:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789515264 00000100:00100000:2.0:1789127420.374403:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1789127420.374412:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:14501:x1876035789515264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127420.374552:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:14501:x1876035789515264:12345-0@lo:502:llog_process_th.0 Request processed in 141us (1334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.374560:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1789127420.374659:0:14501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14501:1876035789515264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127420.374687:0:14501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127420.374692:0:14501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127420.374694:0:14501:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789127420.374698:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:2.0:1789127420.374917:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:2.0:1789127420.374939:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127420.374948:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127420.374959:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127420.374969:0:6520:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127420.374971:0:6520:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934687bf9800 from 13 10000000:01000000:2.0:1789127420.374974:0:6520:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127420.374998:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127420.375006:0:6520:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127420.375025:0:6520:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127420.375040:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812a92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789515392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127420.375070:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127420.375099:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127420.376013:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789515392 00000100:00100000:1.0:1789127420.376021:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789515392 00000100:00100000:1.0:1789127420.376105:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:1.0:1789127420.376116:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:6520:x1876035789515392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127420.376127:0:6516:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127420.376141:0:6516:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93458858c800/0xd718aadfd785d8df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785d8d8 expref: -99 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127420.376164:0:6516:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93458858c800/0xd718aadfd785d8df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785d8d8 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127420.376175:0:6516:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93458858c800/0xd718aadfd785d8df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785d8d8 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127420.376183:0:6516:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c800, rc 0) 00000100:00100000:1.0:1789127420.376233:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789515392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (1162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127420.376240:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000040:00080000:3.0:1789127420.376931:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789127420.381138:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812a92c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789515392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127420.381174:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127420.381186:0:6520:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127420.381265:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789515520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127420.381409:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127420.381451:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ac180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127420.381473:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789515520 00000100:00100000:0.0:1789127420.381478:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789515520 00000100:00100000:0.0:1789127420.381794:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1789127420.381805:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789515520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127420.381924:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789515520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127420.381932:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1789127420.381976:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789515520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127420.382019:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789515648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127420.382443:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127420.382470:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ac180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127420.382485:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789515648 00000100:00100000:0.0:1789127420.382489:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789515648 00000100:00100000:0.0:1789127420.382747:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789127420.382757:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789515648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127420.382844:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:6520:x1876035789515648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127420.382860:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1789127420.382908:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a8b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2eb81216-4f2e-430c-a0f6-5094c3b40588:6520:1876035789515648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127420.383271:0:14504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14504:1876035789515776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127420.383394:0:14504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127420.383424:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789515776 00000100:00100000:0.0:1789127420.383428:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789515776 00000100:00100000:0.0:1789127420.383457:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1789127420.383465:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:14504:x1876035789515776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127420.385543:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:14504:x1876035789515776:12345-0@lo:502:llog_process_th.0 Request processed in 2071us (2225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127420.385557:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1789127420.385626:0:14504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b726b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789127420.387453:0:14504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14504:1876035789515776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127420.387504:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127420.387530:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127420.387533:0:14504:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789127420.387540:0:14504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff934687bf9800 00000020:00000080:0.0:1789127420.387543:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127420.387627:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127420.387631:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127420.387632:0:14504:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789127420.387635:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127420.387638:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127420.387639:0:14504:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789127420.387642:0:14504:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff934687bf9800 00000020:00000080:0.0:1789127420.387655:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789127420.387716:0:14504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14504:1876035789515904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127420.387777:0:14504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127420.387822:0:14504:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dd2d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127420.390563:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789515904 00000100:00100000:1.0:1789127420.390575:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789515904 00000100:00100000:1.0:1789127420.390634:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1789127420.390644:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:14504:x1876035789515904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127420.390795:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:14504:x1876035789515904:12345-0@lo:502:llog_process_th.0 Request processed in 152us (3017us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127420.390820:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:0.0:1789127420.391100:0:14504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a8b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2eb81216-4f2e-430c-a0f6-5094c3b40588:14504:1876035789515904:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127420.391135:0:14504:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127420.391142:0:14504:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127420.391145:0:14504:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789127420.391149:0:14504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:1.0:1789127420.391587:0:6520:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:1.0:1789127420.391616:0:6520:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127420.391626:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127420.391636:0:6520:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127420.401773:0:14505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789127420.424991:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127420.425032:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127420.425056:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127420.425076:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127420.425101:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127420.425128:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771596544 00000100:00100000:2.0:1789127420.425136:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771596544 00000100:00100000:2.0:1789127420.425184:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771596416 00000100:00100000:2.0:1789127420.425188:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771596416 00000100:00100000:2.0:1789127420.425200:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771596928 00000100:00100000:2.0:1789127420.425203:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771596928 00000100:00100000:2.0:1789127420.425215:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771596800 00000100:00100000:2.0:1789127420.425217:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771596800 00000100:00100000:2.0:1789127420.425232:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 248 00000100:00100000:2.0:1789127420.425241:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771596544:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127420.425307:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771596544:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 66us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.425314:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 248 00000100:00100000:2.0:1789127420.425330:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 249 00000100:00100000:2.0:1789127420.425351:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771596416:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127420.425406:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771596416:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 56us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.425412:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 249 00000100:00100000:2.0:1789127420.425425:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 250 00000100:00100000:2.0:1789127420.425432:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771596928:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127420.425456:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812abc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771596928:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.425463:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 250 00000100:00100000:2.0:1789127420.425474:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 251 00000100:00100000:2.0:1789127420.425480:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771596800:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127420.425504:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771596800:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.425533:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 251 00000100:00100000:2.0:1789127420.425552:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771596672 00000100:00100000:2.0:1789127420.425555:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771596672 00000100:00100000:2.0:1789127420.425583:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00100000:2.0:1789127420.425589:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771596672:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127420.425614:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771596672:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127420.425619:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00080000:2.0:1789127420.425641:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127420.425645:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127420.425647:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789127420.855796:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127421.432154:0:14505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789127421.436445:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789127421.879669:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127422.268583:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789516032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127422.268675:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127422.268903:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789516032 00000100:00100000:0.0:1789127422.268911:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789516032 00000100:00100000:0.0:1789127422.268962:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789127422.268972:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587895680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789516032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127422.269005:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789127422.278921:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587895680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789516032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 9941us (10236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127422.278936:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789127422.285240:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789516032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127422.775905:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789516160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127422.775975:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127422.776105:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789516160 00000100:00100000:1.0:1789127422.776112:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789516160 00000100:00100000:1.0:1789127422.776168:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789127422.776178:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789516160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789127422.776204:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127422.776247:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789516160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127422.776255:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789127422.776384:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789516416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127422.776426:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127422.776446:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127422.776451:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789516288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127422.776473:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127422.776540:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789516288 00000100:00100000:1.0:1789127422.776545:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789516288 00000100:00100000:1.0:1789127422.776579:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789127422.776586:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789516288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127422.776606:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789127422.776640:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789516288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127422.776655:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:3.0:1789127422.777135:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127422.777148:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789516416 00000100:00100000:3.0:1789127422.777151:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789516416 00000100:00100000:3.0:1789127422.777189:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789127422.777195:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789516416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127422.777207:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127422.777240:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789516416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127422.777246:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789127422.777266:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789516672:0@lo:400:kworker.0 00000100:00100000:3.0:1789127422.777294:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127422.777310:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789517184:0@lo:400:kworker.0 00000100:00100000:3.0:1789127422.777333:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789127422.777374:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b72a8b40 x1876035789516160/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127422.777390:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789516160:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127422.777405:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789127422.777410:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789516544:0@lo:400:kworker.0 00000100:00100000:3.0:1789127422.777432:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127422.777450:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789517056:0@lo:400:kworker.0 00000100:00100000:3.0:1789127422.777479:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127422.777493:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789517568:0@lo:400:kworker.0 00000100:00100000:3.0:1789127422.777549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789127422.777710:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127422.777832:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789516800:0@lo:400:kworker.0 00000100:00100000:0.0:1789127422.777859:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127422.777878:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789517312:0@lo:400:kworker.0 00000100:00100000:0.0:1789127422.777897:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127422.777911:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789127422.777915:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789516928:0@lo:400:kworker.0 00000100:00100000:0.0:1789127422.777934:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127422.777942:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789517440:0@lo:400:kworker.0 00000100:00100000:0.0:1789127422.777957:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127422.777992:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789516544 00000100:00100000:0.0:1789127422.777996:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789516544 00000100:00100000:0.0:1789127422.778025:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1789127422.778032:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789516544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127422.778069:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789516544:12345-0@lo:400:kworker.0 Request processed in 38us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127422.778076:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:0.0:1789127422.778108:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789516544:0@lo:400:kworker.0 00000100:00100000:1.0:1789127422.778172:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789516672 00000100:00100000:1.0:1789127422.778176:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789516672 00000100:00100000:1.0:1789127422.778197:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789517056 00000100:00100000:1.0:1789127422.778199:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789517056 00000100:00100000:1.0:1789127422.778226:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789517568 00000100:00100000:1.0:1789127422.778229:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789517568 00000100:00100000:1.0:1789127422.778240:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789516800 00000100:00100000:1.0:1789127422.778242:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789516800 00000100:00100000:1.0:1789127422.778251:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789516928 00000100:00100000:1.0:1789127422.778253:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789516928 00000100:00100000:1.0:1789127422.778262:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789517440 00000100:00100000:1.0:1789127422.778265:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789517440 00000100:00100000:1.0:1789127422.778276:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789127422.778282:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789516672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127422.778318:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789516672:12345-0@lo:400:kworker.0 Request processed in 37us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127422.778324:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789127422.778336:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789127422.778342:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789517056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127422.778379:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789517056:12345-0@lo:400:kworker.0 Request processed in 38us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127422.778385:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789127422.778397:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789127422.778402:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587894b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789517568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127422.778429:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587894b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789517568:12345-0@lo:400:kworker.0 Request processed in 27us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127422.778445:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789127422.778459:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789127422.778464:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789516800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127422.778497:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789516800:12345-0@lo:400:kworker.0 Request processed in 33us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127422.778503:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789127422.778537:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789127422.778544:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789516928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127422.778573:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789516928:12345-0@lo:400:kworker.0 Request processed in 30us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127422.778578:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789127422.778590:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789127422.778596:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789517440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127422.778622:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789517440:12345-0@lo:400:kworker.0 Request processed in 27us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127422.778628:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789127422.778645:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789517184 00000100:00100000:1.0:1789127422.778648:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789517184 00000100:00100000:1.0:1789127422.778670:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789517312 00000100:00100000:1.0:1789127422.778673:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789517312 00000100:00100000:1.0:1789127422.778689:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789127422.778695:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587894780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789517184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127422.778725:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587894780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789517184:12345-0@lo:400:kworker.0 Request processed in 30us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127422.778732:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789127422.778768:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789127422.778775:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1876035789517312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127422.778805:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1876035789517312:12345-0@lo:400:kworker.0 Request processed in 32us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127422.778811:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789127422.779048:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e712c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789516288:0@lo:41:osp-pre-1-0.0 00010000:00080000:2.0:1789127422.779063:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346812a8780 x1876035789516416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127422.779076:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789516416:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789127422.779181:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127422.779184:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127422.779186:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127422.779205:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789516928:0@lo:400:kworker.0 00000100:00100000:0.0:1789127422.779215:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789517440:0@lo:400:kworker.0 00000100:00100000:0.0:1789127422.779225:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789516800:0@lo:400:kworker.0 00000100:00100000:0.0:1789127422.779235:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789517312:0@lo:400:kworker.0 00010000:00080000:0.0:1789127422.779263:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587e70f00 x1876035789517056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127422.779273:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e70f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789517056:0@lo:400:kworker.0 00010000:00080000:0.0:1789127422.779284:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587fb0b40 x1876035789517568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127422.779292:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789517568:0@lo:400:kworker.0 00000100:00100000:0.0:1789127422.779300:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e70780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789516672:0@lo:400:kworker.0 00000100:00100000:0.0:1789127422.779309:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789517184:0@lo:400:kworker.0 00010000:00010000:1.0:1789127422.903704:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127423.287814:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789517696:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127423.287882:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127423.288092:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127423.288102:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789517824:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127423.288131:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127423.288273:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789517696 00000100:00100000:1.0:1789127423.288282:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789517696 00000100:00100000:1.0:1789127423.288329:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789517824 00000100:00100000:1.0:1789127423.288332:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789517824 00000100:00100000:1.0:1789127423.288348:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789127423.288368:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789517696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127423.288396:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127423.288442:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e73840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789517696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127423.288448:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789127423.288464:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789127423.288470:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789517824:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127423.288480:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127423.288527:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789517824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 38us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127423.288534:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789127423.288584:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789517696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127423.289125:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812a8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789517824:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1789127423.806487:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1789127423.927939:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127424.952560:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127425.533741:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127425.533776:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127425.533804:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127425.533826:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127425.533843:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127425.533862:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127425.533928:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771597312 00000100:00100000:2.0:1789127425.533937:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771597312 00000100:00100000:2.0:1789127425.533987:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771597568 00000100:00100000:2.0:1789127425.533989:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771597568 00000100:00100000:2.0:1789127425.534001:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771597184 00000100:00100000:2.0:1789127425.534003:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771597184 00000100:00100000:2.0:1789127425.534012:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771597696 00000100:00100000:2.0:1789127425.534014:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771597696 00000100:00100000:2.0:1789127425.534039:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 258 00000100:00100000:2.0:1789127425.534047:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771597312:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127425.534108:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771597312:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 62us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127425.534115:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 258 00000100:00100000:2.0:1789127425.534141:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 259 00000100:00100000:2.0:1789127425.534157:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771597568:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127425.534180:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771597568:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 33us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127425.534185:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 259 00000100:00100000:2.0:1789127425.534195:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 260 00000100:00100000:2.0:1789127425.534200:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771597184:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127425.534219:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771597184:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 19us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127425.534224:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 260 00000100:00100000:2.0:1789127425.534232:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 261 00000100:00100000:2.0:1789127425.534237:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771597696:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127425.534253:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771597696:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 16us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127425.534259:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 261 00000100:00100000:2.0:1789127425.534273:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771597440 00000100:00100000:2.0:1789127425.534275:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771597440 00000100:00100000:2.0:1789127425.534298:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 93 00000100:00100000:2.0:1789127425.534303:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771597440:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127425.534323:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771597440:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 20us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127425.534328:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 93 00000100:00100000:1.0:1789127425.534761:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771597056 00000100:00100000:1.0:1789127425.534766:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771597056 00000100:00100000:1.0:1789127425.534810:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 434 00000100:00100000:1.0:1789127425.534817:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771597056:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127425.534846:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771597056:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 30us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127425.534852:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 434 00000100:00080000:0.0:1789127425.535001:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127425.535014:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127425.535016:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789127425.976432:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127427.001653:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127427.383986:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789517952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127427.384056:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127427.384230:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789517952 00000100:00100000:0.0:1789127427.384238:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789517952 00000100:00100000:0.0:1789127427.384296:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789127427.384306:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789517952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127427.384356:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789127427.384409:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789517952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127427.384416:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789127427.384618:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789517952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127427.896441:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789518208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127427.896527:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458783b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789518080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127427.896555:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127427.896583:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127427.896646:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789518080 00000100:00100000:3.0:1789127427.896653:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789518080 00000100:00100000:3.0:1789127427.896716:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789127427.896726:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587896580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789518080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127427.896754:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127427.896799:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587896580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789518080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127427.896806:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:3.0:1789127427.896845:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93458783b840 x1876035789518080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127427.896860:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458783b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789518080:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789127427.896931:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127427.897084:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789518592:0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.897104:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789518336:0@lo:400:kworker.0 00000100:00100000:0.0:1789127427.897118:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127427.897143:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789519104:0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.897155:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127427.897186:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789518848:0@lo:400:kworker.0 00000100:00100000:0.0:1789127427.897191:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127427.897215:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789519616:0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.897223:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127427.897249:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789519360:0@lo:400:kworker.0 00000100:00100000:0.0:1789127427.897250:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127427.897272:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789127427.897290:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127427.897295:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789518720:0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.897314:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789127427.897335:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b738a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789518464:0@lo:400:kworker.0 00000100:00100000:0.0:1789127427.897343:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127427.897368:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789519232:0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.897375:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127427.897404:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789518976:0@lo:400:kworker.0 00000100:00100000:0.0:1789127427.897405:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127427.897436:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127427.897450:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789518208 00000100:00100000:1.0:1789127427.897451:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789519488:0@lo:400:kworker.0 00000100:00100000:0.0:1789127427.897458:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789518208 00000100:00100000:1.0:1789127427.897480:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127427.897502:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789518336 00000100:00100000:1.0:1789127427.897506:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789518336 00000100:00100000:1.0:1789127427.897575:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1789127427.897581:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789518336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.897617:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789518336:12345-0@lo:400:kworker.0 Request processed in 36us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127427.897623:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1789127427.897649:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789518848 00000100:00100000:1.0:1789127427.897652:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789518848 00000100:00100000:1.0:1789127427.897677:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789519360 00000100:00100000:1.0:1789127427.897680:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789519360 00000100:00100000:1.0:1789127427.897691:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789518720 00000100:00100000:1.0:1789127427.897693:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789518720 00000100:00100000:1.0:1789127427.897702:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789518464 00000100:00100000:1.0:1789127427.897704:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789518464 00000100:00100000:1.0:1789127427.897713:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789518976 00000100:00100000:1.0:1789127427.897715:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789518976 00000100:00100000:1.0:1789127427.897725:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789519488 00000100:00100000:1.0:1789127427.897727:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789519488 00000100:00100000:1.0:1789127427.897740:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789127427.897745:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789518848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.897777:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789518848:12345-0@lo:400:kworker.0 Request processed in 32us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127427.897784:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789127427.897795:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789127427.897801:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789519360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.897829:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789519360:12345-0@lo:400:kworker.0 Request processed in 28us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127427.897834:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789127427.897845:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789127427.897851:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789518720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.897895:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789518720:12345-0@lo:400:kworker.0 Request processed in 44us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127427.897901:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789127427.897912:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789127427.897917:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789518464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.897942:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789518464:12345-0@lo:400:kworker.0 Request processed in 25us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127427.897947:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789127427.897960:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789127427.897965:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789518976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.897991:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789518976:12345-0@lo:400:kworker.0 Request processed in 25us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127427.897996:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789127427.898007:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789127427.898013:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7395680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789519488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.898053:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7395680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789519488:12345-0@lo:400:kworker.0 Request processed in 40us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127427.898058:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1789127427.898077:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127427.898080:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127427.898105:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b738a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789518464:0@lo:400:kworker.0 00010000:00080000:1.0:1789127427.898116:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93458840cf00 x1876035789518976/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127427.898124:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789518976:0@lo:400:kworker.0 00010000:00080000:1.0:1789127427.898148:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebda40 x1876035789519488/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127427.898157:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789519488:0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.898164:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789518336:0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.898173:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789518848:0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.898181:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789519360:0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.898213:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789518720:0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.898242:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789519104 00000100:00100000:1.0:1789127427.898246:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789519104 00000100:00100000:1.0:1789127427.898272:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789519616 00000100:00100000:1.0:1789127427.898275:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789519616 00000100:00100000:1.0:1789127427.898288:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789519232 00000100:00100000:1.0:1789127427.898290:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789519232 00000100:00100000:1.0:1789127427.898302:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789127427.898308:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789519104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.898358:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789519104:12345-0@lo:400:kworker.0 Request processed in 50us (1170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127427.898366:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789127427.898378:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789127427.898384:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789519616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.898411:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789519616:12345-0@lo:400:kworker.0 Request processed in 27us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127427.898417:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789127427.898426:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789127427.898438:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789519232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.898467:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789519232:12345-0@lo:400:kworker.0 Request processed in 30us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127427.898473:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1789127427.898487:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127427.898490:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127427.898504:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789127427.898529:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9346b72aa1c0, transno 4294967301 00000100:00100000:1.0:1789127427.898541:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789519232:0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.898555:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789519104:0@lo:400:kworker.0 00010000:00080000:1.0:1789127427.898565:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587e5f0c0 x1876035789519616/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127427.898573:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789519616:0@lo:400:kworker.0 00000100:00100000:0.0:1789127427.899697:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789518592 00000100:00100000:0.0:1789127427.899704:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789518592 00000100:00100000:0.0:1789127427.899727:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789127427.899734:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789518208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789127427.899759:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127427.899804:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789518208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (3251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127427.899810:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789127427.899822:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789127427.899827:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789518592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127427.899857:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789518592:12345-0@lo:400:kworker.0 Request processed in 29us (2739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127427.899862:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789127427.899894:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7389a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789518592:0@lo:400:kworker.0 00000100:00100000:1.0:1789127427.900820:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789518208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127427.901050:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789519744:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127427.901097:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127427.901480:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789519744 00000100:00100000:2.0:1789127427.901487:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789519744 00000100:00100000:2.0:1789127427.901568:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789127427.901578:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789519744:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127427.901597:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127427.901639:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789519744:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127427.901646:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1789127427.902023:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587838000 x1876035789519744/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127427.902101:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789519744:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789127428.023664:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127428.407744:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127428.408439:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458783ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789520000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127428.410680:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127428.410835:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789520000 00000100:00100000:0.0:1789127428.410846:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789520000 00000100:00100000:0.0:1789127428.410921:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789127428.410932:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789520000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127428.410964:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127428.413803:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789520000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2864us (3122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127428.413831:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789127428.414817:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458783ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789520000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127428.414831:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789519872:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127428.414877:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127428.415052:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789519872 00000100:00100000:2.0:1789127428.415058:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789519872 00000100:00100000:2.0:1789127428.415100:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789127428.415109:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587895a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789519872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789127428.415130:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127428.415179:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587895a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789519872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127428.415186:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789127428.415460:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789519872:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789127429.047875:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127430.074791:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127430.654471:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127430.654550:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127430.654588:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127430.654613:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127430.654630:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127430.654661:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127430.654705:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771598208 00000100:00100000:2.0:1789127430.654715:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771598208 00000100:00100000:1.0:1789127430.654745:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771597952 00000100:00100000:1.0:1789127430.654751:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771597952 00000100:00100000:1.0:1789127430.654786:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771598464 00000100:00100000:2.0:1789127430.654797:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:1.0:1789127430.654803:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771598464 00000100:00100000:2.0:1789127430.654811:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771598208:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127430.654824:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771598080 00000100:00100000:1.0:1789127430.654828:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771598080 00000100:00100000:1.0:1789127430.654855:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771598336 00000100:00100000:1.0:1789127430.654859:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771598336 00000100:00100000:1.0:1789127430.654878:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 268 00000100:00100000:2.0:1789127430.654885:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771598208:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 76us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127430.654889:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692920f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771597952:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127430.654898:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:1.0:1789127430.654929:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692920f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771597952:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 43us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127430.654931:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 269 00000100:00100000:1.0:1789127430.654943:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 268 00000100:00100000:2.0:1789127430.654944:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771598464:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127430.654962:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 270 00000100:00100000:1.0:1789127430.654971:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771598080:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127430.654989:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771598464:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 48us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127430.654998:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 269 00000100:00100000:1.0:1789127430.655004:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771598080:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 34us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127430.655010:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 270 00000100:00100000:2.0:1789127430.655018:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 271 00000100:00100000:2.0:1789127430.655028:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771598336:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127430.655034:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771597824 00000100:00100000:1.0:1789127430.655038:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771597824 00000100:00100000:2.0:1789127430.655070:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771598336:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 43us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127430.655077:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 271 00000100:00100000:1.0:1789127430.655085:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 436 00000100:00100000:1.0:1789127430.655104:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2400:x1876035771597824:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127430.655132:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2400:x1876035771597824:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 31us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127430.655140:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 436 00000100:00080000:0.0:1789127430.655656:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127430.655662:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127430.655665:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789127431.095666:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789127431.673008:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789127431.673449:0:14505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789127432.119920:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127432.504620:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789520128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127432.504700:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127432.504851:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789520128 00000100:00100000:2.0:1789127432.504859:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789520128 00000100:00100000:2.0:1789127432.504914:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789127432.504925:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789520128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127432.504956:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789127432.512080:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789520128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7147us (7370us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127432.512095:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789127432.512349:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789520128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127433.015942:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587838780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789520256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127433.016025:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127433.016207:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789520256 00000100:00100000:3.0:1789127433.016215:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789520256 00000100:00100000:3.0:1789127433.016280:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789127433.016291:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789520256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127433.016330:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127433.016374:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789520256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127433.016382:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1789127433.016615:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789127433.016644:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587838780 x1876035789520256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127433.016663:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587838780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789520256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127433.017363:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789520384:0@lo:400:kworker.0 00000100:00100000:1.0:1789127433.017410:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127433.017455:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789520896:0@lo:400:kworker.0 00000100:00100000:1.0:1789127433.017480:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127433.017499:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789521408:0@lo:400:kworker.0 00000100:00100000:1.0:1789127433.017542:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127433.017564:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789127433.017570:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789520512:0@lo:400:kworker.0 00000100:00100000:1.0:1789127433.017595:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127433.017612:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789521024:0@lo:400:kworker.0 00000100:00100000:1.0:1789127433.017632:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127433.017646:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789521536:0@lo:400:kworker.0 00000100:00100000:1.0:1789127433.017667:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127433.017689:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789520384 00000100:00100000:1.0:1789127433.017694:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789520384 00000100:00100000:1.0:1789127433.017729:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:1.0:1789127433.017738:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789520384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127433.017866:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127433.017876:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789521920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127433.017905:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127433.017932:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789520896 00000100:00100000:3.0:1789127433.017935:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789520896 00000100:00100000:3.0:1789127433.017958:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789521920 00000100:00100000:3.0:1789127433.017961:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789521920 00000100:00100000:3.0:1789127433.017973:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789127433.017979:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1876035789520896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127433.018032:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1876035789520896:12345-0@lo:400:kworker.0 Request processed in 53us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127433.018039:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789127433.018053:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789127433.018059:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789521920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127433.018079:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789127433.018109:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789521920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 51us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127433.018115:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789127433.018142:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789521920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127433.018185:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789521408 00000100:00100000:3.0:1789127433.018189:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789521408 00000100:00100000:3.0:1789127433.018221:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789127433.018227:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789521408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127433.018257:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789521408:12345-0@lo:400:kworker.0 Request processed in 30us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127433.018263:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789127433.018282:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789520512 00000100:00100000:3.0:1789127433.018286:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789520512 00000100:00100000:3.0:1789127433.018316:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789521024 00000100:00100000:3.0:1789127433.018320:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789521024 00000100:00100000:3.0:1789127433.018333:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789521536 00000100:00100000:3.0:1789127433.018335:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789521536 00000100:00100000:3.0:1789127433.018347:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789127433.018352:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7389a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789520512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127433.018381:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7389a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789520512:12345-0@lo:400:kworker.0 Request processed in 29us (786us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127433.018387:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789127433.018397:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789127433.018403:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b738a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789521024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127433.018428:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b738a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789521024:12345-0@lo:400:kworker.0 Request processed in 25us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127433.018433:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789127433.018444:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789127433.018450:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789521536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127433.018475:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b09e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789521536:12345-0@lo:400:kworker.0 Request processed in 25us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127433.018490:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789127433.018551:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789520512:0@lo:400:kworker.0 00000100:00100000:3.0:1789127433.018560:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789521024:0@lo:400:kworker.0 00000100:00100000:3.0:1789127433.018567:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789521536:0@lo:400:kworker.0 00000100:00100000:3.0:1789127433.018575:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789520896:0@lo:400:kworker.0 00000100:00100000:3.0:1789127433.018581:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789521408:0@lo:400:kworker.0 00000100:00100000:2.0:1789127433.018980:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127433.018990:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789522048:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127433.019079:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127433.019174:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789522048 00000100:00100000:0.0:1789127433.019179:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789522048 00000100:00100000:0.0:1789127433.019217:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789127433.019226:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789522048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789127433.019239:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127433.019391:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789522048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 165us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127433.019404:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1789127433.019423:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127433.019426:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127433.019428:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127433.019438:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789520768:0@lo:400:kworker.0 00000100:00100000:0.0:1789127433.019466:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127433.019485:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789521280:0@lo:400:kworker.0 00000100:00100000:0.0:1789127433.019506:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127433.019536:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789521792:0@lo:400:kworker.0 00000100:00100000:0.0:1789127433.019553:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127433.019568:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789127433.019572:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789520640:0@lo:400:kworker.0 00000100:00100000:0.0:1789127433.019592:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127433.019607:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789521152:0@lo:400:kworker.0 00000100:00100000:0.0:1789127433.019625:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127433.019646:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789521664:0@lo:400:kworker.0 00000100:00100000:0.0:1789127433.019667:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127433.019688:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789520640 00000100:00100000:0.0:1789127433.019692:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789520640 00000100:00100000:0.0:1789127433.019717:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789127433.019724:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789520640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127433.019844:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789521280 00000100:00100000:2.0:1789127433.019848:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789521280 00000100:00100000:2.0:1789127433.019880:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789521792 00000100:00100000:2.0:1789127433.019883:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789521792 00000100:00100000:2.0:1789127433.019899:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789127433.019905:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789521280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127433.020079:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789520768 00000100:00100000:3.0:1789127433.020083:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789520768 00000100:00100000:3.0:1789127433.020107:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789521152 00000100:00100000:3.0:1789127433.020110:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789521152 00000100:00100000:3.0:1789127433.020122:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789521664 00000100:00100000:3.0:1789127433.020124:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789521664 00000100:00100000:3.0:1789127433.020138:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789127433.020144:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789520768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127433.020916:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789521280:12345-0@lo:400:kworker.0 Request processed in 1008us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127433.020925:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789127433.020946:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789127433.020955:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789521792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127433.020985:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f09680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789521792:12345-0@lo:400:kworker.0 Request processed in 34us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127433.020991:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789127433.021030:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789127433.021038:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789521152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127433.021069:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789521152:12345-0@lo:400:kworker.0 Request processed in 33us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127433.021076:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1789127433.021091:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1789127433.021097:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789521664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127433.021124:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e843c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789521664:12345-0@lo:400:kworker.0 Request processed in 28us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127433.021130:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00080000:2.0:1789127433.021145:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127433.021149:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789127433.021199:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9345878392c0 x1876035789522048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127433.021218:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789522048:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1789127433.021315:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346928f61c0 x1876035789521152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127433.021341:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789521152:0@lo:400:kworker.0 00010000:00080000:2.0:1789127433.021354:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93458840f480 x1876035789521664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127433.021363:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789521664:0@lo:400:kworker.0 00000100:00100000:2.0:1789127433.021374:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789521280:0@lo:400:kworker.0 00010000:00080000:2.0:1789127433.021383:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93458840da40 x1876035789521792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127433.021391:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789521792:0@lo:400:kworker.0 00000100:00100000:3.0:1789127433.023525:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f0b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789520768:12345-0@lo:400:kworker.0 Request processed in 3363us (4040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127433.023537:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789127433.023724:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789520768:0@lo:400:kworker.0 00000100:00100000:0.0:1789127433.023933:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e85a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789520640:12345-0@lo:400:kworker.0 Request processed in 4208us (4338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127433.023942:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789127433.024012:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789520640:0@lo:400:kworker.0 00000100:00100000:1.0:1789127433.024153:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789520384:12345-0@lo:400:kworker.0 Request processed in 6414us (6745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127433.024161:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1789127433.024386:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789520384:0@lo:400:kworker.0 00010000:00010000:1.0:1789127433.144102:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127433.528111:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789522176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127433.528121:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789522304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127433.531639:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127433.533449:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127433.550792:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789522304 00000100:00100000:0.0:1789127433.550824:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789522304 00000100:00100000:0.0:1789127433.550953:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789522176 00000100:00100000:0.0:1789127433.550957:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789522176 00000100:00100000:0.0:1789127433.550980:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789127433.550989:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789522304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789127433.551027:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127433.551123:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789522304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 135us (19491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127433.551130:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789127433.551145:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789127433.551153:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789522176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127433.551162:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127433.551207:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878961c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789522176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (17763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127433.551333:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789522304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127433.551376:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e84b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789522176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127433.551672:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00010000:2.0:1789127434.172373:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127435.193609:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127435.777306:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127435.777363:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127435.777406:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127435.777554:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771598848 00000100:00100000:0.0:1789127435.777563:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771598848 00000100:00100000:0.0:1789127435.777625:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771598720 00000100:00100000:0.0:1789127435.777628:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771598720 00000100:00100000:0.0:1789127435.777648:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 278 00000100:00100000:0.0:1789127435.777658:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771598848:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127435.777724:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 279 00000100:00100000:0.0:1789127435.777730:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771598848:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 71us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127435.777741:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771598720:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127435.777742:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 278 00000100:00100000:3.0:1789127435.777789:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771598720:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 53us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127435.777798:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 279 00000100:00080000:2.0:1789127435.778064:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127435.778069:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127435.779349:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771598592 00000100:00100000:1.0:1789127435.779360:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771598592 00000100:00100000:1.0:1789127435.779416:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 438 00000100:00100000:1.0:1789127435.779425:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771598592:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127435.779486:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771598592:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 63us (2189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127435.779535:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 438 00000100:00100000:2.0:1789127435.787103:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127435.787158:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127435.787198:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127435.787462:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771599104 00000100:00100000:1.0:1789127435.787472:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771599104 00000100:00100000:1.0:1789127435.787559:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771599232 00000100:00100000:1.0:1789127435.787563:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771599232 00000100:00100000:1.0:1789127435.787585:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 280 00000100:00100000:1.0:1789127435.787594:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771599104:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127435.787662:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771599104:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 68us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127435.787669:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 280 00000100:00100000:1.0:1789127435.787685:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 281 00000100:00100000:1.0:1789127435.787691:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771599232:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127435.787714:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771599232:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 23us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127435.787719:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 281 00000100:00080000:2.0:1789127435.787864:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127435.787868:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127435.787945:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771598976 00000100:00100000:0.0:1789127435.787951:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771598976 00000100:00100000:0.0:1789127435.788010:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:0.0:1789127435.788019:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587838780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2398:x1876035771598976:12345-192.168.206.48@tcp:9:kworker.0 00000020:00000080:0.0:1789127435.788047:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d806 00000100:00080000:0.0:1789127435.788056:0:8438:0:(import.c:65:import_set_state_nolock()) ffff934587ff0000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789127435.788098:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1789127435.788230:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587838780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+2:2398:x1876035771598976:12345-192.168.206.48@tcp:9:kworker.0 Request processed in 212us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127435.788238:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00010000:00010000:0.0:1789127435.788257:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789127435.788403:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789127436.215754:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127437.239777:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127437.623910:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127437.623934:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789522432:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127437.624002:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127437.624128:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789522432 00000100:00100000:0.0:1789127437.624136:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789522432 00000100:00100000:0.0:1789127437.624188:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789127437.624197:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587896940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789522432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127437.624228:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789127437.624301:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587896940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789522432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127437.624308:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789127437.624392:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789522432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127438.135955:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789522944:0@lo:400:kworker.0 00000100:00100000:0.0:1789127438.136023:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127438.136082:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789523456:0@lo:400:kworker.0 00000100:00100000:0.0:1789127438.136113:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127438.136132:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789523968:0@lo:400:kworker.0 00000100:00100000:0.0:1789127438.136157:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127438.136204:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789522944 00000100:00100000:1.0:1789127438.136211:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789522944 00000100:00100000:3.0:1789127438.136241:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789522560:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.136258:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1789127438.136278:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789522944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127438.136291:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127438.136319:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789523072:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.136335:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e870c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789522944:12345-0@lo:400:kworker.0 Request processed in 66us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127438.136344:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789127438.136350:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127438.136374:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789523584:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.136398:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789523072 00000100:00100000:3.0:1789127438.136405:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789522688:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.136418:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789523072 00000100:00100000:3.0:1789127438.136432:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127438.136453:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789127438.136454:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789523200:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.136463:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789523072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127438.136482:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127438.136503:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789523712:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.136530:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789523072:12345-0@lo:400:kworker.0 Request processed in 69us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127438.136538:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789127438.136551:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127438.136572:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789524224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127438.136584:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789522688 00000100:00100000:1.0:1789127438.136589:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789522688 00000100:00100000:3.0:1789127438.136599:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127438.136614:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789523200 00000100:00100000:1.0:1789127438.136618:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789523200 00000100:00100000:3.0:1789127438.136626:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1789127438.136635:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789522816:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.136641:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789523712 00000100:00100000:1.0:1789127438.136645:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789523712 00000100:00100000:3.0:1789127438.136667:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127438.136668:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1789127438.136676:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587897c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789522688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127438.136688:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789523328:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.136716:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587897c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789522688:12345-0@lo:400:kworker.0 Request processed in 40us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127438.136724:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789127438.136731:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127438.136738:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789523328 00000100:00100000:1.0:1789127438.136742:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789523328 00000100:00100000:3.0:1789127438.136749:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789523840:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.136763:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1789127438.136771:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587897840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789523200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127438.136779:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127438.136791:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789524352:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127438.136810:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587897840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789523200:12345-0@lo:400:kworker.0 Request processed in 40us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127438.136818:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1789127438.136823:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127438.136831:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789523840 00000100:00100000:1.0:1789127438.136835:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789523840 00000100:00100000:1.0:1789127438.136855:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789127438.136865:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789522688:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.136865:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789523712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127438.136884:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789523200:0@lo:400:kworker.0 00000100:00100000:3.0:1789127438.136918:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789522816 00000100:00100000:3.0:1789127438.136922:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789522816 00000100:00100000:1.0:1789127438.136926:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789523712:12345-0@lo:400:kworker.0 Request processed in 64us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127438.136934:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789127438.136949:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789127438.136958:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789127438.136959:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789523328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127438.136970:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789522816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.136994:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789523328:12345-0@lo:400:kworker.0 Request processed in 37us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127438.137000:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789127438.137015:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789127438.137016:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789522816:12345-0@lo:400:kworker.0 Request processed in 46us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127438.137025:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789523840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127438.137026:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789127438.137064:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789523840:12345-0@lo:400:kworker.0 Request processed in 41us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127438.137073:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789522816:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.137073:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00080000:3.0:1789127438.137091:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7dede00 x1876035789523328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127438.137097:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789522560 00000100:00100000:1.0:1789127438.137102:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789522560 00000100:00100000:3.0:1789127438.137103:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789523328:0@lo:400:kworker.0 00010000:00080000:3.0:1789127438.137117:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692b4f0c0 x1876035789523840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127438.137126:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789523840:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.137131:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 439 00000100:00100000:3.0:1789127438.137138:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789523712:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.137142:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789522560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.137181:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54fbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789522560:12345-0@lo:400:kworker.0 Request processed in 43us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127438.137188:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 439 00000100:00100000:1.0:1789127438.137283:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127438.137289:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789524480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127438.137321:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127438.137344:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789522944:0@lo:400:kworker.0 00000100:00100000:0.0:1789127438.137364:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789524480 00000100:00100000:0.0:1789127438.137374:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789524480 00000100:00100000:0.0:1789127438.137398:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789127438.137403:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789524480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789127438.137426:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127438.137459:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e84b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789524480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127438.137465:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789127438.137492:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789524480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127438.137529:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789524224 00000100:00100000:0.0:1789127438.137532:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789524224 00000100:00100000:0.0:1789127438.137560:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789524352 00000100:00100000:0.0:1789127438.137563:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789524352 00000100:00100000:0.0:1789127438.137578:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789127438.137583:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789524224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127438.137599:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127438.137631:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789524224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127438.137638:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789127438.137648:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789127438.137654:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7396d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789524352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789127438.137662:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127438.137682:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7396d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789524352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 29us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127438.137687:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:0.0:1789127438.137709:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73a12c0 x1876035789524352/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127438.137733:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789524352:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1789127438.137744:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93458840da40 x1876035789524224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127438.137754:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789524224:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789127438.137788:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127438.137792:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127438.137794:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127438.138303:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789523456 00000100:00100000:2.0:1789127438.138308:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789523456 00000100:00100000:2.0:1789127438.138344:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789523968 00000100:00100000:2.0:1789127438.138347:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789523968 00000100:00080000:0.0:1789127438.138434:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127438.138461:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789127438.138469:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789523456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127438.138544:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e861c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789523456:12345-0@lo:400:kworker.0 Request processed in 76us (2430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127438.138551:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789127438.138582:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789523456:0@lo:400:kworker.0 00000100:00100000:2.0:1789127438.138911:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789127438.138917:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789523968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127438.138957:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e852c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789523968:12345-0@lo:400:kworker.0 Request processed in 41us (2801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127438.138963:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00010000:00080000:2.0:1789127438.138986:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692b4e940 x1876035789523968/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127438.138997:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789523968:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.141834:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789524096:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.141892:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127438.141983:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789522560:0@lo:400:kworker.0 00000100:00100000:1.0:1789127438.141997:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789523072:0@lo:400:kworker.0 00000100:00100000:0.0:1789127438.142282:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789523584 00000100:00100000:0.0:1789127438.142288:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789523584 00000100:00100000:0.0:1789127438.142399:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789524096 00000100:00100000:0.0:1789127438.142402:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789524096 00000100:00080000:1.0:1789127438.142468:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127438.146844:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789127438.146865:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789523584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127438.146945:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789523584:12345-0@lo:400:kworker.0 Request processed in 90us (9673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127438.146952:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789127438.146967:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789127438.146973:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789524096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127438.147009:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789524096:12345-0@lo:400:kworker.0 Request processed in 37us (5118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127438.147015:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789127438.148313:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789523584:0@lo:400:kworker.0 00010000:00080000:1.0:1789127438.148333:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73a0b40 x1876035789524096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127438.148343:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789524096:0@lo:400:kworker.0 00010000:00010000:0.0:1789127438.263945:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127438.650082:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127438.650105:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789524608:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127438.650171:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127438.650351:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127438.650362:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789524736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789127438.650391:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127438.650530:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789524608 00000100:00100000:2.0:1789127438.650537:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789524608 00000100:00100000:2.0:1789127438.650586:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789524736 00000100:00100000:2.0:1789127438.650589:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789524736 00000100:00100000:2.0:1789127438.650608:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789127438.650617:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789524608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127438.650656:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127438.650720:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7397480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789524608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127438.650728:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789127438.650749:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789127438.650757:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789524736:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127438.650771:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789524608:0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127438.650784:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127438.650829:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789524736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127438.650836:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789127438.650903:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789524736:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789127439.290179:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127440.311664:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127440.893685:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127440.893728:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127440.893749:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127440.893768:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127440.893799:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127440.893825:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771599360 00000100:00100000:2.0:1789127440.893834:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771599360 00000100:00100000:2.0:1789127440.893878:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 440 00000100:00100000:2.0:1789127440.893887:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2400:x1876035771599360:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127440.893951:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2400:x1876035771599360:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 64us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127440.893959:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 440 00000100:00100000:2.0:1789127440.893990:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771599488 00000100:00100000:2.0:1789127440.893994:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771599488 00000100:00100000:2.0:1789127440.894024:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771599616 00000100:00100000:2.0:1789127440.894027:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771599616 00000100:00100000:2.0:1789127440.894040:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771599744 00000100:00100000:2.0:1789127440.894042:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771599744 00000100:00100000:2.0:1789127440.894053:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771599872 00000100:00100000:2.0:1789127440.894055:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771599872 00000100:00100000:2.0:1789127440.894068:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 288 00000100:00100000:2.0:1789127440.894074:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771599488:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127440.894102:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771599488:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 28us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127440.894115:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 288 00000100:00100000:2.0:1789127440.894128:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 289 00000100:00100000:2.0:1789127440.894134:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771599616:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127440.894156:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771599616:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 23us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127440.894162:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 289 00000100:00100000:2.0:1789127440.894172:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 290 00000100:00100000:2.0:1789127440.894178:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771599744:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127440.894196:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771599744:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 19us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127440.894202:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 290 00000100:00100000:2.0:1789127440.894212:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 291 00000100:00100000:2.0:1789127440.894217:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771599872:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127440.894234:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771599872:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 17us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127440.894239:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 291 00000100:00080000:2.0:1789127440.894396:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127440.894400:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789127441.343643:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789127441.723581:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000020:00000080:1.0:1789127441.723590:0:8433:0:(genops.c:885:class_export_put()) final put ffff934587ff2800/2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000020:00000080:3.0:1789127441.723674:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff934587ff2800/2eecd753-97f2-4dc9-9442-17e5ef8fda22 for lustre-OST0000 00000020:00000080:3.0:1789127441.723743:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934587ff0000 for lustre-OST0000 00000040:00080000:1.0:1789127441.915560:0:14505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789127441.916679:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789127442.360419:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127442.746470:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789524864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127442.746573:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127442.746733:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789524864 00000100:00100000:3.0:1789127442.746741:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789524864 00000100:00100000:3.0:1789127442.746789:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789127442.746798:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789524864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127442.746827:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789127442.746871:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789524864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127442.746880:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789127442.747047:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789524864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127443.255820:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789525248:0@lo:400:kworker.0 00000100:00100000:2.0:1789127443.255889:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127443.255951:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789525760:0@lo:400:kworker.0 00000100:00100000:2.0:1789127443.255978:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127443.256000:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789526272:0@lo:400:kworker.0 00000100:00100000:2.0:1789127443.256036:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127443.256060:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789127443.256066:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789525376:0@lo:400:kworker.0 00000100:00100000:2.0:1789127443.256088:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127443.256111:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789525888:0@lo:400:kworker.0 00000100:00100000:2.0:1789127443.256134:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127443.256149:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789526400:0@lo:400:kworker.0 00000100:00100000:2.0:1789127443.256167:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127443.256194:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789525760 00000100:00100000:2.0:1789127443.256200:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789525760 00000100:00100000:3.0:1789127443.256392:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789525248 00000100:00100000:3.0:1789127443.256396:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789525248 00000100:00100000:3.0:1789127443.256428:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789127443.256437:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789525248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.256570:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789524992:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.256604:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127443.256628:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789525504:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.256649:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127443.256665:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789526016:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.256685:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127443.256699:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789526528:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.256718:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127443.256736:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789127443.256742:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789525120:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.256763:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127443.259471:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789525248:12345-0@lo:400:kworker.0 Request processed in 3027us (3573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127443.259484:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789127443.259531:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789525504 00000100:00100000:3.0:1789127443.259537:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789525504 00000100:00100000:3.0:1789127443.259570:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789127443.259578:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789525504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127443.259642:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789525504:12345-0@lo:400:kworker.0 Request processed in 65us (2992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127443.259665:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789127443.261133:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789525888 00000100:00100000:1.0:1789127443.261140:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789525888 00000100:00100000:1.0:1789127443.261181:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789526400 00000100:00100000:1.0:1789127443.261185:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789526400 00000100:00100000:1.0:1789127443.261199:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789526016 00000100:00100000:1.0:1789127443.261201:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789526016 00000100:00100000:1.0:1789127443.261213:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789526528 00000100:00100000:1.0:1789127443.261216:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789526528 00000100:00100000:1.0:1789127443.261231:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789127443.261256:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7391a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789525888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127443.261316:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7391a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789525888:12345-0@lo:400:kworker.0 Request processed in 77us (5180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127443.261323:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789127443.261338:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789127443.261353:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7390b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789526400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127443.261385:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7390b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789526400:12345-0@lo:400:kworker.0 Request processed in 34us (5216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127443.261391:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789127443.261404:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789127443.261410:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789526016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127443.261438:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed121c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789526016:12345-0@lo:400:kworker.0 Request processed in 28us (4752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127443.261444:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789127443.261455:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789127443.261461:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed12d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789526528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127443.261488:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed12d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789526528:12345-0@lo:400:kworker.0 Request processed in 27us (4769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127443.261493:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789127443.261539:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789526912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127443.261574:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127443.261604:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127443.261611:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789526784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127443.261634:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127443.261672:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789526912 00000100:00100000:1.0:1789127443.261676:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789526912 00000100:00100000:1.0:1789127443.261697:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789526784 00000100:00100000:1.0:1789127443.261701:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789526784 00000100:00100000:1.0:1789127443.261714:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789127443.261719:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789526912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789127443.261738:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127443.261778:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789526912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127443.261785:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789127443.261797:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789127443.261804:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789526784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789127443.261813:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127443.261837:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789526784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 34us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127443.261843:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789127443.261868:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789526656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127443.261894:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789127443.261950:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73a3840 x1876035789526784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127443.261967:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789526784:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789127443.261979:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b73a30c0 x1876035789526912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127443.261990:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789526912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127443.262013:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789526656 00000100:00100000:1.0:1789127443.262017:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789526656 00000100:00100000:1.0:1789127443.262042:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789127443.262048:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789526656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127443.262068:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789127443.262101:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789526656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127443.262106:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789127443.262143:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789526656:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127443.262186:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789524992 00000100:00100000:1.0:1789127443.262190:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789524992 00000100:00100000:1.0:1789127443.262213:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:1.0:1789127443.262219:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b54f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789524992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127443.262262:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b54f9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789524992:12345-0@lo:400:kworker.0 Request processed in 43us (5658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127443.262269:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00080000:1.0:1789127443.262318:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127443.262322:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789127443.262324:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127443.266386:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789525632:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.266444:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127443.266469:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789526144:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.266504:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127443.266551:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789524992:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.266567:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789525504:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.266580:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e89e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789526016:0@lo:400:kworker.0 00010000:00080000:0.0:1789127443.266594:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ee4780 x1876035789526528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127443.266604:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789526528:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.266998:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789526272 00000100:00100000:0.0:1789127443.267004:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789526272 00000100:00100000:0.0:1789127443.267054:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789525376 00000100:00100000:0.0:1789127443.267058:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789525376 00000100:00100000:0.0:1789127443.267070:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789525120 00000100:00100000:0.0:1789127443.267072:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789525120 00000100:00100000:0.0:1789127443.267081:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789525632 00000100:00100000:0.0:1789127443.267084:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789525632 00000100:00100000:0.0:1789127443.267095:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789526144 00000100:00100000:0.0:1789127443.267098:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789526144 00000100:00100000:0.0:1789127443.267112:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789127443.267119:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7392580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789525760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.267170:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7392580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789525760:12345-0@lo:400:kworker.0 Request processed in 51us (11190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127443.267177:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1789127443.267193:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789127443.267199:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7390780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789526272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.267224:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7390780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789526272:12345-0@lo:400:kworker.0 Request processed in 26us (11188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127443.267237:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789127443.267266:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789127443.267272:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7391680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789525376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.267302:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7391680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789525376:12345-0@lo:400:kworker.0 Request processed in 31us (11213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127443.267308:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789127443.267318:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1789127443.267324:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789525120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.267351:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed10f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789525120:12345-0@lo:400:kworker.0 Request processed in 28us (10588us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127443.267358:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1789127443.267368:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789127443.267374:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789525632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.267396:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed11a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789525632:12345-0@lo:400:kworker.0 Request processed in 23us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127443.267402:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789127443.267411:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789127443.267416:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789526144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.267439:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789526144:12345-0@lo:400:kworker.0 Request processed in 23us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127443.267444:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1789127443.267473:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789525120:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.267483:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789525632:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.267503:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789526144:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.267559:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692b4e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789525376:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.267572:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789525888:0@lo:400:kworker.0 00010000:00080000:0.0:1789127443.267583:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e8b480 x1876035789526400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127443.267594:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789526400:0@lo:400:kworker.0 00000100:00100000:0.0:1789127443.267605:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789525248:0@lo:400:kworker.0 00010000:00080000:0.0:1789127443.267615:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7dee580 x1876035789525760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127443.267623:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789525760:0@lo:400:kworker.0 00010000:00080000:0.0:1789127443.267632:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e8a1c0 x1876035789526272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127443.267639:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789526272:0@lo:400:kworker.0 00000100:00080000:0.0:1789127443.267672:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127443.267677:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789127443.383755:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127443.771646:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789527040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127443.771716:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127443.771913:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789527168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127443.771943:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127443.771976:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789527040 00000100:00100000:1.0:1789127443.771983:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789527040 00000100:00100000:1.0:1789127443.772022:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789527168 00000100:00100000:1.0:1789127443.772025:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789527168 00000100:00100000:1.0:1789127443.772041:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789127443.772049:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789527040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127443.772078:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127443.772117:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789527040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127443.772124:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789127443.772255:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789127443.772266:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789527168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127443.772278:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127443.772326:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789527168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127443.772332:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789127443.772469:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789527040:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789127443.772572:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789527168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789127444.407872:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789127445.344286:0:14764:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 07:50:43 (1789127443) 00010000:00010000:0.0:1789127445.433070:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127446.013157:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127446.013411:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771600000 00000100:00100000:2.0:1789127446.013421:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771600000 00000100:00100000:2.0:1789127446.013477:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 442 00000100:00100000:2.0:1789127446.013486:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2402:x1876035771600000:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127446.013590:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2402:x1876035771600000:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 104us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127446.013597:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 442 00000100:00100000:2.0:1789127446.029877:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127446.029926:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127446.029958:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127446.030088:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127446.032286:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771600128 00000100:00100000:3.0:1789127446.032299:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771600128 00000100:00100000:3.0:1789127446.032353:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771600256 00000100:00100000:3.0:1789127446.032356:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771600256 00000100:00100000:3.0:1789127446.032370:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771600384 00000100:00100000:3.0:1789127446.032372:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771600384 00000100:00100000:3.0:1789127446.032697:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771600512 00000100:00100000:3.0:1789127446.032700:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771600512 00000100:00100000:3.0:1789127446.032718:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 298 00000100:00100000:3.0:1789127446.032726:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771600128:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127446.032800:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771600128:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 75us (2933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127446.032808:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 298 00000100:00100000:3.0:1789127446.032825:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 299 00000100:00100000:3.0:1789127446.032832:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771600256:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127446.032856:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771600256:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 24us (2929us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127446.032862:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 299 00000100:00100000:3.0:1789127446.032873:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 300 00000100:00100000:3.0:1789127446.032893:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771600384:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127446.036310:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 301 00000100:00100000:1.0:1789127446.036344:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771600512:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127446.038486:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771600384:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 5585us (8518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127446.038500:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 300 00000100:00080000:3.0:1789127446.038580:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789127446.038585:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127446.042803:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771600512:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 6455us (12703us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127446.042818:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 301 00010000:00010000:1.0:1789127446.456294:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127447.289625:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127447.289718:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771600640 00000100:00100000:3.0:1789127447.289727:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771600640 00000100:00100000:3.0:1789127447.289790:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:3.0:1789127447.289800:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:11352:x1876035771600640:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127447.289818:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127447.289840:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d8e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffbee expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.289899:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785d8ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.289912:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785d8ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.289925:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785d8ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127447.289971:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789127447.289975:0:9447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127447.290014:0:9447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785d8ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.290036:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d8e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbee expref: 7 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.290068:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785d8ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbee expref: 6 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.290077:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586ef4100) 00010000:00010000:3.0:1789127447.290080:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127447.290083:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a1c00, rc 0) 00000100:00100000:3.0:1789127447.290188:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:11352:x1876035771600640:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 389us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127447.290196:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:1.0:1789127447.298674:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127447.298761:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771600768 00000100:00100000:0.0:1789127447.298771:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771600768 00000100:00100000:0.0:1789127447.298843:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:0.0:1789127447.298853:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:11353:x1876035771600768:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127447.298874:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127447.298894:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785d8f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffbf5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.298952:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d8fb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.298965:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d8fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.298976:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d8fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.298989:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d902 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.298994:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299000:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299052:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d909 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299066:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d909 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299072:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d909 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127447.299118:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789127447.299122:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127447.299142:0:6522:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d909 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299153:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d8fb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299159:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d8fb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299164:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d8fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299170:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fede00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127447.299173:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d8fb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299180:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d8fb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299192:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586ef4100) 00010000:00010000:0.0:1789127447.299194:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127447.299199:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d8fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299205:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d8fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299216:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d902 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299243:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d902 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299250:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d902 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299255:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127447.299258:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d902 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299265:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d902 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299273:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9346a69cb000) 00010000:00010000:0.0:1789127447.299275:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127447.299278:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d902 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299283:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d902 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299311:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785d8f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbf5 expref: 8 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299324:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d909 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbf5 expref: 7 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127447.299331:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9346a69cb900) 00010000:00010000:0.0:1789127447.299333:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127447.299343:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587feca00, rc 0) 00000100:00100000:0.0:1789127447.299406:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:11353:x1876035771600768:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 554us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127447.299414:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:1.0:1789127447.304348:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127447.304431:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771600896 00000100:00100000:0.0:1789127447.304440:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771600896 00000100:00100000:0.0:1789127447.304497:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:0.0:1789127447.304545:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:11353:x1876035771600896:12345-192.168.206.48@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789127447.304631:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:11353:x1876035771600896:12345-192.168.206.48@tcp:900:lhsmtool_posix.0 Request processed in 125us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127447.304640:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1789127447.314018:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127447.314099:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771601152 00000100:00100000:3.0:1789127447.314109:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771601152 00000100:00100000:3.0:1789127447.314170:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:3.0:1789127447.314180:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:11353:x1876035771601152:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127447.314199:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127447.314217:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d910 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffbfc expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314296:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d917 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314310:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d917 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314321:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d917 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314334:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d91e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314355:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d91e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314362:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d91e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314461:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785d925 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314469:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785d925 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314476:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785d925 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127447.314485:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789127447.314605:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d917 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314612:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d917 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314619:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d917 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314625:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127447.314629:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d917 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314637:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d917 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314659:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9346a69cb900) 00010000:00010000:3.0:1789127447.314662:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127447.314667:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d917 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314673:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785d917 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314686:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d91e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314692:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d91e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314697:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d91e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314701:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0a00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127447.314704:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d91e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314709:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d91e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314717:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff934586ef4d00) 00010000:00010000:3.0:1789127447.314719:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127447.314722:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d91e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314728:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785d91e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.314998:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785d910 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbfc expref: 10 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.315013:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785d925 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbfc expref: 9 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127447.315021:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4200) 00010000:00010000:3.0:1789127447.315023:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127447.315025:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff600, rc 0) 00000100:00100000:3.0:1789127447.315077:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:11353:x1876035771601152:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 899us (1067us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789127447.315085:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:2.0:1789127447.320346:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127447.320464:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771601280 00000100:00100000:0.0:1789127447.320473:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771601280 00000100:00100000:0.0:1789127447.320538:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:0.0:1789127447.320548:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:11353:x1876035771601280:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789127447.320650:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:11353:x1876035771601280:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 Request processed in 103us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127447.320658:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:1.0:1789127447.328791:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127447.328994:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771601408 00000100:00100000:3.0:1789127447.329003:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771601408 00000100:00100000:3.0:1789127447.329110:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:3.0:1789127447.329120:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:11353:x1876035771601408:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1789127447.335284:0:9447:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 6124us 00000100:00100000:2.0:1789127447.363966:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:11353:x1876035771601408:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 Request processed in 34839us (35175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127447.363980:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00010000:00010000:1.0:1789127447.480658:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127447.868069:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127447.868092:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789527296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127447.868168:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127447.868239:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789527296 00000100:00100000:3.0:1789127447.868246:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789527296 00000100:00100000:3.0:1789127447.868287:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789127447.868296:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789527296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127447.868328:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789127447.868371:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789527296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127447.868385:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789127447.868438:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789527296:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789127448.059106:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789127448.063614:0:14505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789127448.376358:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789527552:0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.376427:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127448.376473:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789528064:0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.376496:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127448.376547:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789528576:0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.376581:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127448.376619:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789127448.376626:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789527680:0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.376651:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127448.376672:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789528192:0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.376696:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127448.376713:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789528704:0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.376733:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127448.376763:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789527552 00000100:00100000:0.0:1789127448.376770:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789527552 00000100:00100000:0.0:1789127448.376803:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789528064 00000100:00100000:0.0:1789127448.376805:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789528064 00000100:00100000:0.0:1789127448.376826:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789528576 00000100:00100000:0.0:1789127448.376829:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789528576 00000100:00100000:0.0:1789127448.376841:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789527680 00000100:00100000:0.0:1789127448.376843:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789527680 00000100:00100000:0.0:1789127448.376857:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789127448.376865:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789527552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.376912:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789527552:12345-0@lo:400:kworker.0 Request processed in 48us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.376920:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1789127448.376935:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789127448.376941:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789528064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.376968:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789528064:12345-0@lo:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.376974:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1789127448.376984:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789127448.376990:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aeca5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789528576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.377027:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aeca5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789528576:12345-0@lo:400:kworker.0 Request processed in 37us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.377033:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1789127448.377045:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789127448.377051:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789527680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.377075:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789527680:12345-0@lo:400:kworker.0 Request processed in 25us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.377081:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1789127448.377107:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789528192 00000100:00100000:0.0:1789127448.377111:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789528192 00000100:00100000:0.0:1789127448.377136:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789528704 00000100:00100000:0.0:1789127448.377139:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789528704 00000100:00100000:0.0:1789127448.377156:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789127448.377163:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789528192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.377191:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789528192:12345-0@lo:400:kworker.0 Request processed in 29us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.377197:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789127448.377208:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789127448.377227:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789528704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.377255:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789528704:12345-0@lo:400:kworker.0 Request processed in 41us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.377260:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:0.0:1789127448.377279:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789127448.377283:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127448.377285:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127448.377321:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789527680:0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.377344:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789528192:0@lo:400:kworker.0 00000100:00100000:1.0:1789127448.377351:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789527808:0@lo:400:kworker.0 00010000:00080000:0.0:1789127448.377357:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93468528cf00 x1876035789528704/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127448.377369:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789528704:0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.377382:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789527552:0@lo:400:kworker.0 00000100:00100000:1.0:1789127448.377391:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789127448.377394:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93468528f840 x1876035789528064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127448.377405:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789528064:0@lo:400:kworker.0 00000100:00100000:1.0:1789127448.377417:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789528320:0@lo:400:kworker.0 00010000:00080000:0.0:1789127448.377421:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93468528ed00 x1876035789528576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127448.377431:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789528576:0@lo:400:kworker.0 00000100:00100000:1.0:1789127448.377447:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127448.377469:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789528832:0@lo:400:kworker.0 00000100:00100000:1.0:1789127448.377489:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127448.377528:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789127448.377537:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789527424:0@lo:400:kworker.0 00000100:00100000:1.0:1789127448.377569:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127448.377581:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789529216:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127448.377598:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789527936:0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.377628:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127448.377642:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127448.377655:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789127448.377665:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789529088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127448.377668:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789528448:0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.377704:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127448.377705:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127448.377722:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127448.377731:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789528960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127448.377739:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789527808 00000100:00100000:0.0:1789127448.377744:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789527808 00000100:00100000:1.0:1789127448.377761:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127448.377771:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789529216 00000100:00100000:0.0:1789127448.377775:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789529216 00000100:00100000:0.0:1789127448.377791:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789127448.377803:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789127448.377803:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789527808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127448.377816:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789529216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127448.377843:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127448.377848:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789527808:12345-0@lo:400:kworker.0 Request processed in 48us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.377861:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789127448.377885:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789529088 00000100:00100000:1.0:1789127448.377886:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e89e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789529216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 72us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.377890:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789529088 00000100:00100000:1.0:1789127448.377895:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789127448.377920:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789528320 00000100:00100000:1.0:1789127448.377924:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789528320 00000100:00100000:0.0:1789127448.377926:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789528960 00000100:00100000:0.0:1789127448.377931:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789528960 00000100:00100000:0.0:1789127448.377952:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789127448.377957:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789528832 00000100:00100000:0.0:1789127448.377961:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789529088:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127448.377963:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789528832 00002000:00000024:0.0:1789127448.377982:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127448.377991:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789127448.378000:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586046580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789528320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.378014:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789529088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.378021:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1789127448.378033:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789127448.378039:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588769e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789528960:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789127448.378047:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127448.378067:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588769e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789528960:12345-0@lo:13:osp-pre-1-1.0 Request processed in 29us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.378073:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1789127448.378092:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789127448.378098:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345860443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789528832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.378119:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345860443c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789528832:12345-0@lo:400:kworker.0 Request processed in 22us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.378124:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789127448.378141:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789527936 00000100:00100000:0.0:1789127448.378144:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789527936 00000100:00100000:0.0:1789127448.378164:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789528448 00000100:00100000:0.0:1789127448.378166:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789528448 00000100:00100000:0.0:1789127448.378192:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789127448.378198:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789527936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.378239:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789527936:12345-0@lo:400:kworker.0 Request processed in 41us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.378245:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789127448.378256:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1789127448.378262:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789528448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.378287:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789528448:12345-0@lo:400:kworker.0 Request processed in 26us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.378292:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:0.0:1789127448.378311:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127448.378314:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127448.378315:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789127448.378332:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e8b0c0 x1876035789529088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127448.378346:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789529088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127448.378357:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e892c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789529216:0@lo:41:osp-pre-1-0.0 00010000:00080000:0.0:1789127448.378387:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7e8b480 x1876035789528960/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127448.378398:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789528960:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127448.378406:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789527936:0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.378414:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789528448:0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.378422:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789527808:0@lo:400:kworker.0 00010000:00080000:0.0:1789127448.378441:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93468528f480 x1876035789528832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127448.378448:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789528832:0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.378489:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789527424 00000100:00100000:0.0:1789127448.378493:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789527424 00000100:00100000:0.0:1789127448.378538:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1789127448.378545:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789527424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127448.378577:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789527424:12345-0@lo:400:kworker.0 Request processed in 33us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.378584:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1789127448.378616:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789527424:0@lo:400:kworker.0 00000100:00100000:1.0:1789127448.379112:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586046580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789528320:12345-0@lo:400:kworker.0 Request processed in 1111us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127448.379120:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789127448.379197:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789528320:0@lo:400:kworker.0 00010000:00010000:3.0:1789127448.505394:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127448.887938:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127448.887961:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345887683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789529344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127448.888023:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127448.888080:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789529344 00000100:00100000:1.0:1789127448.888087:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789529344 00000100:00100000:0.0:1789127448.888915:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127448.888928:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789529472:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127448.888964:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127448.889000:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789529472 00000100:00100000:0.0:1789127448.889005:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789529472 00000100:00100000:0.0:1789127448.889036:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789127448.889046:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789529472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789127448.889073:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127448.889226:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789127448.889235:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588769680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789529344:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127448.889254:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789529472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 210us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127448.889262:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789127448.889307:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789529472:0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127448.891414:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127448.891501:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588769680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789529344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2265us (3475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127448.891525:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789127448.891973:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345887683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789529344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127449.231191:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127449.231761:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771601536 00000100:00100000:3.0:1789127449.231771:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771601536 00000100:00100000:3.0:1789127449.231836:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:3.0:1789127449.231847:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:11395:x1876035771601536:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127449.231866:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127449.231886:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785d933 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc03 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.231947:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785d93a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.231961:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785d93a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.231973:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785d93a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.231986:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785d941 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.231993:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785d941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.231999:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785d941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232059:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785d93a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232066:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785d93a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232073:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785d93a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232080:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127449.232084:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785d93a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232091:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785d93a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232103:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586ef4100) 00010000:00010000:3.0:1789127449.232106:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127449.232110:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785d93a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232116:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785d93a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232125:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785d941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232130:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785d941 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232135:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785d941 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232145:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127449.232148:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785d941 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232155:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785d941 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232163:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff934587df4b00) 00010000:00010000:3.0:1789127449.232165:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127449.232168:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785d941 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232174:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785d941 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232203:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785d933 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc03 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789127449.232346:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789127449.232381:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586ef4100) 00010000:00010000:3.0:1789127449.232384:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127449.232388:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785d933 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc03 expref: 10 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.232399:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ffa00, rc 0) 00000100:00100000:3.0:1789127449.232459:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:11395:x1876035771601536:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 613us (1276us total) trans 0 rc 301/301 00000100:00100000:3.0:1789127449.232466:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:2.0:1789127449.239439:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127449.239833:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771601792 00000100:00100000:3.0:1789127449.239848:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771601792 00000100:00100000:3.0:1789127449.239905:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:3.0:1789127449.239916:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345863e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:11395:x1876035771601792:12345-192.168.206.48@tcp:36:lfs.0 00010000:00010000:3.0:1789127449.239970:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127449.239996:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785d8ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbee expref: 9 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.240012:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586ef4100) 00010000:00010000:3.0:1789127449.240021:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127449.240077:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d948 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.240090:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d948 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.240099:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d948 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.240110:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785d94f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.240116:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785d94f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.240122:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785d94f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.240604:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785d956 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.240614:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785d956 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.240921:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785d956 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127449.240938:0:6524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000078621ab9 reply state 000000002032970a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785d956 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.240949:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785d956 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.240955:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:3.0:1789127449.240958:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127449.240961:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789127449.240966:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789127449.240972:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d948 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.240979:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d948 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.240984:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d948 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.240990:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127449.240994:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d948 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.241000:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d948 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.241007:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934587df4300) 00010000:00010000:3.0:1789127449.241010:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127449.241018:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d948 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.241024:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d948 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127449.241039:0:6524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000078621ab9 reply state 000000002032970a transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785d94f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.241047:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785d94f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.241052:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff934587df4400) 00010000:00010000:3.0:1789127449.241054:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127449.241056:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789127449.241157:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345863e6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+10:11395:x1876035771601792:12345-192.168.206.48@tcp:36:lfs.0 Request processed in 1241us (1724us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789127449.241165:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:0.0:1789127449.308189:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127449.308244:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771601920 00000100:00100000:2.0:1789127449.308253:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771601920 00000100:00100000:2.0:1789127449.308308:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:2.0:1789127449.308317:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+10:11403:x1876035771601920:12345-192.168.206.48@tcp:101:lctl.0 00010000:00010000:2.0:1789127449.308338:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127449.308358:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785d95d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc0a expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.308478:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d964 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.308492:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.308503:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127449.308571:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789127449.308575:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127449.308611:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d964 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.308634:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785d95d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc0a expref: 12 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.308650:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d964 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc0a expref: 11 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.308670:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346b7218d00) 00010000:00010000:2.0:1789127449.308673:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127449.308677:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6800, rc 0) 00000100:00100000:2.0:1789127449.308727:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+11:11403:x1876035771601920:12345-192.168.206.48@tcp:101:lctl.0 Request processed in 412us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127449.308734:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:1.0:1789127449.360923:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127449.361269:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771602048 00000100:00100000:0.0:1789127449.361279:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771602048 00000100:00100000:0.0:1789127449.361337:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:0.0:1789127449.361347:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588768f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+11:11409:x1876035771602048:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1789127449.361365:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127449.361383:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785d96b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc11 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361440:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d972 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361453:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361464:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361473:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d979 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361480:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361486:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361601:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d980 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361636:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d980 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361643:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d980 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127449.361674:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789127449.361678:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127449.361714:0:6522:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d980 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361725:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d972 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361731:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d972 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361737:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d972 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361743:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fedc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127449.361747:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d972 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361755:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d972 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361766:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346b7218d00) 00010000:00010000:0.0:1789127449.361769:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127449.361774:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d972 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361790:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785d972 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361803:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d979 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361810:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d979 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361816:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d979 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361821:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fede00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127449.361824:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d979 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361831:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d979 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361838:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff934587df4400) 00010000:00010000:0.0:1789127449.361841:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127449.361843:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d979 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361849:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785d979 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361873:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785d96b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc11 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361885:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d980 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc11 expref: 12 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.361898:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:0.0:1789127449.361900:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789127449.361903:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec200, rc 0) 00000100:00100000:0.0:1789127449.361958:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588768f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+12:11409:x1876035771602048:12345-192.168.206.48@tcp:101:bash.0 Request processed in 612us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127449.361965:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:0.0:1789127449.365022:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127449.366206:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771602304 00000100:00100000:3.0:1789127449.366228:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771602304 00000100:00100000:2.0:1789127449.366339:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:2.0:1789127449.366350:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+12:11409:x1876035771602304:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1789127449.366368:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127449.366405:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785d987 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc18 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.366525:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d98e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.366549:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d98e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.366560:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d98e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.366597:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785d995 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.366605:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785d995 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.366612:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785d995 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789127449.366934:0:9447:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:2.0:1789127449.367080:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785d99c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.367089:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785d99c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.367097:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785d99c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.367127:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d98e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.367134:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d98e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.367141:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d98e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.367148:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127449.367152:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d98e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.367160:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d98e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.367171:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:2.0:1789127449.367175:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127449.367180:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d98e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.367196:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785d98e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127449.367219:0:9447:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001bb0d294 reply state 0000000079c27474 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785d995 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.367231:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785d995 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.367237:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9346b7218100) 00010000:00010000:2.0:1789127449.367239:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789127449.367242:0:9447:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789127449.367269:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785d987 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc18 expref: 15 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.367284:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785d99c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc18 expref: 14 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.367291:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218200) 00010000:00010000:2.0:1789127449.367293:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127449.367295:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6200, rc 0) 00000100:00100000:2.0:1789127449.367359:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:11409:x1876035771602304:12345-192.168.206.48@tcp:101:bash.0 Request processed in 1010us (2346us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1789127449.367368:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:1.0:1789127449.371801:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127449.372319:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771602432 00000100:00100000:0.0:1789127449.372329:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771602432 00000100:00100000:0.0:1789127449.372378:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:0.0:1789127449.372386:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1876035771602432:12345-192.168.206.48@tcp:8:bash.0 00010000:00080000:0.0:1789127449.372420:0:8440:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp t0 exp 0000000000000000 cur 410 last 0 00000020:00000080:0.0:1789127449.372451:0:8440:0:(genops.c:1385:class_connect()) connect: client 2eecd753-97f2-4dc9-9442-17e5ef8fda22, cookie 0xd718aadfd785d9aa 00002000:00100000:0.0:1789127449.372463:0:8440:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2eecd753-97f2-4dc9-9442-17e5ef8fda22/ffff934587e11800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789127449.372473:0:8440:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789127449.372576:0:8440:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789127449.372605:0:8440:0:(import.c:65:import_set_state_nolock()) ffff934587e15000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127449.372673:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2398:x1876035771602432:12345-192.168.206.48@tcp:8:bash.0 Request processed in 286us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127449.372681:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:1.0:1789127449.376977:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127449.377078:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771602560 00000100:00100000:0.0:1789127449.377088:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771602560 00000100:00100000:0.0:1789127449.377170:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:0.0:1789127449.377180:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588768780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:0:x1876035771602560:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1789127449.377221:0:8755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127449.377247:0:8755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785d9b1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc1f expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789127449.377274:0:8755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127449.377293:0:8755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1789127449.377297:0:8755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127449.377307:0:8755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785d9b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc1f expref: 7 pid: 8755 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.377326:0:8755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785d9b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc1f expref: 7 pid: 8755 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.377339:0:8755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec000, rc 0) 00000100:00100000:0.0:1789127449.377402:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588768780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:0:x1876035771602560:12345-192.168.206.48@tcp:101:bash.0 Request processed in 223us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127449.377408:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00080000:2.0:1789127449.378452:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127449.380759:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127449.383913:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771602688 00000100:00100000:1.0:1789127449.383993:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771602688 00000100:00100000:1.0:1789127449.384655:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:1.0:1789127449.385007:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:11409:x1876035771602688:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1789127449.385623:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127449.385646:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc26 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127449.385688:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785d9b1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc1f expref: 8 pid: 8755 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127449.385706:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127449.385712:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127449.385718:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127449.386594:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785d9b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc1f expref: 8 pid: 8755 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127449.386615:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785d9b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc1f expref: 8 pid: 8755 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127449.386629:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588768000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1876035789529600:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789127449.387611:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dec900 going to sleep for 11 seconds 00000100:00100000:1.0:1789127449.390605:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588768000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8439:1876035789529600:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127449.390640:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 8 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127449.390981:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c000, rc 0) 00000100:00100000:1.0:1789127449.391051:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:11409:x1876035771602688:12345-192.168.206.48@tcp:101:bash.0 Request processed in 6049us (10299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127449.391060:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:3.0:1789127449.392077:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127449.392143:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771602816 00000100:00100000:0.0:1789127449.392151:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771602816 00010000:00010000:0.0:1789127449.392186:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785d9b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc1f expref: 8 pid: 8755 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127449.392237:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:0.0:1789127449.392246:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2402:x1876035771602816:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127449.392259:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127449.392279:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785d9b1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc1f expref: 8 pid: 8755 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.392306:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785d9b1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc1f expref: 8 pid: 8755 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.392330:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785d9b1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc1f expref: 8 pid: 8755 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.392345:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127449.392349:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127449.392357:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.392368:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.392400:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127449.392413:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1876035789529728:192.168.206.48@tcp:105: 00000100:00100000:0.0:1789127449.392469:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dd26c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127449.397134:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127449.397238:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771603072 00000100:00100000:1.0:1789127449.397247:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771603072 00000100:00100000:1.0:1789127449.397305:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:1.0:1789127449.397315:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:11409:x1876035771603072:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:1.0:1789127449.397627:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:11409:x1876035771603072:12345-192.168.206.48@tcp:35:bash.0 Request processed in 302us (491us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789127449.397636:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1789127449.400203:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1876035789529728:192.168.206.48@tcp:105: 00010000:00010000:0.0:1789127449.400240:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127449.400300:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771602816:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 8054us (8226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127449.400310:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:2.0:1789127449.492161:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127449.493069:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771603328 00000100:00100000:0.0:1789127449.493079:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771603328 00000100:00100000:0.0:1789127449.493138:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:0.0:1789127449.493148:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:11419:x1876035771603328:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127449.493170:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127449.493595:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785d9bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc2d expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127449.493695:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789127449.493792:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785d9bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc2d expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.493805:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346b7218d00) 00010000:00010000:2.0:1789127449.493808:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127449.493813:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785d9bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc2d expref: 18 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.493825:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7a00, rc 0) 00000100:00100000:2.0:1789127449.493981:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+17:11419:x1876035771603328:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 833us (1934us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1789127449.493989:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:3.0:1789127449.497174:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127449.497249:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771603584 00000100:00100000:2.0:1789127449.497258:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771603584 00000100:00100000:2.0:1789127449.497308:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1789127449.497318:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+17:11419:x1876035771603584:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1789127449.498942:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:11419:x1876035771603584:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 1617us (1769us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789127449.498954:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00010000:00010000:1.0:1789127449.527726:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127449.583667:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127449.583791:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771603712 00000100:00100000:2.0:1789127449.583801:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771603712 00000100:00100000:2.0:1789127449.583869:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:2.0:1789127449.583943:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:11425:x1876035771603712:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789127449.583967:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127449.583999:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785d9cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc34 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.584065:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785d9d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.584079:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785d9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.584090:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785d9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127449.584129:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789127449.584132:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127449.584152:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785d9d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.584255:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785d9cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc34 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.584276:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785d9d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc34 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.584284:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:2.0:1789127449.584287:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127449.584290:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7800, rc 0) 00000100:00100000:2.0:1789127449.584349:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:11425:x1876035771603712:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 472us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127449.584356:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:1.0:1789127449.589731:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127449.589847:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771603968 00000100:00100000:3.0:1789127449.589856:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771603968 00000100:00100000:3.0:1789127449.589921:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:3.0:1789127449.589931:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:11425:x1876035771603968:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127449.589950:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127449.589969:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785d9db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc3b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.590084:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d9e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.590099:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.590110:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d9e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127449.590121:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789127449.590421:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785d9db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc3b expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.590437:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d9e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc3b expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.590444:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218200) 00010000:00010000:3.0:1789127449.590447:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127449.590450:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe600, rc 0) 00000100:00100000:3.0:1789127449.590622:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:11425:x1876035771603968:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 691us (896us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789127449.590630:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:0.0:1789127449.595049:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127449.595093:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127449.595187:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771604224 00000100:00100000:2.0:1789127449.595216:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771604224 00000100:00100000:2.0:1789127449.595272:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:2.0:1789127449.595283:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:11425:x1876035771604224:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789127449.595305:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127449.595326:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785d9f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc42 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.595422:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785d9f7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.595436:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785d9f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.595447:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785d9f7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127449.595459:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789127449.595592:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785d9f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc42 expref: 24 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.595608:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785d9f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc42 expref: 23 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.595616:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218200) 00010000:00010000:2.0:1789127449.595619:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789127449.595622:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7c00, rc 0) 00000100:00100000:2.0:1789127449.595683:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:11425:x1876035771604224:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 402us (643us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789127449.595691:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:1.0:1789127449.596128:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771604352 00000100:00100000:1.0:1789127449.596135:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771604352 00000100:00100000:1.0:1789127449.596193:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1789127449.596201:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:2401:x1876035771604352:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127449.596220:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127449.596235:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785d9e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc3b expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127449.596259:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218200) 00010000:00010000:1.0:1789127449.596262:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127449.602885:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:2401:x1876035771604352:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 6672us (7778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127449.602900:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:0.0:1789127449.611784:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127449.612427:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771604480 00000100:00100000:2.0:1789127449.612438:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771604480 00000100:00100000:2.0:1789127449.612621:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:2.0:1789127449.612634:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771604480:12345-192.168.206.48@tcp:1:lfs.0 00010000:00010000:2.0:1789127449.612685:0:10363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785da05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.612705:0:10363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.612714:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127449.612719:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127449.612723:0:10363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785da05 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.612757:0:10363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.612772:0:10363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 7 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127449.612788:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934687b75680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10363:1876035789529856:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127449.613093:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351480 going to sleep for 11 seconds 00000100:00100000:2.0:1789127449.616768:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934687b75680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10363:1876035789529856:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127449.616884:0:10363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785da05 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127449.619324:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127449.619420:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771604608 00000100:00100000:2.0:1789127449.619429:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771604608 00002000:00100000:2.0:1789127449.619469:0:8443:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff93468528fc00 x1876035771604608/t0(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:185/0 lens 504/0 e 0 to 0 dl 1789127460 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789127449.619480:0:8443:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff93468528fc00 with x1876035771604608 ext(0->12) 00010000:00010000:2.0:1789127449.619489:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 8 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.619504:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 8 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127449.619997:0:8443:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93468528fc00 00000100:00100000:2.0:1789127449.620079:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:2.0:1789127449.620092:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2401:x1876035771604608:12345-192.168.206.48@tcp:4:lfs.0 00000001:00100000:1.0:1789127449.621644:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000100:00100000:2.0:1789127449.624419:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2401:x1876035771604608:12345-192.168.206.48@tcp:4:lfs.0 Request processed in 4321us (5094us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789127449.624433:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00002000:00100000:2.0:1789127449.624444:0:8443:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff93468528fc00 x1876035771604608/t4294967300(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:185/0 lens 504/448 e 0 to 0 dl 1789127460 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789127449.624454:0:8443:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff93468528fc00 with x1876035771604608 ext(0->12) 00010000:00010000:2.0:1789127449.624465:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 9 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.624499:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 9 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127449.624526:0:8443:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff93468528fc00 00000100:00100000:0.0:1789127449.626739:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127449.626842:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771604736 00000100:00100000:1.0:1789127449.626852:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771604736 00010000:00010000:1.0:1789127449.626900:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 9 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127449.626939:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:1.0:1789127449.626948:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2399:x1876035771604736:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127449.626962:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789127449.626977:0:6509:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789127449.626980:0:6509:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789127448 00002000:00010000:1.0:1789127449.626983:0:6509:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789127448 00002000:00010000:1.0:1789127449.626985:0:6509:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789127448 00002000:00010000:1.0:1789127449.626987:0:6509:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789127449.626992:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 9 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127449.627006:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 9 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127449.627065:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffd04e55/0xd718aadfd785d9b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc26 expref: 9 pid: 8439 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127449.627082:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789127449.627087:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789127449.627092:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785da05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127449.627103:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785da05 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127449.627139:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127449.627198:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2399:x1876035771604736:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 251us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127449.627219:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00010000:00010000:2.0:1789127449.627476:0:10363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785da05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.627486:0:10363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785da05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.627533:0:10363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785da05 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.627543:0:10363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785da05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.627550:0:10363:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785da05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.627557:0:10363:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7a00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127449.627561:0:10363:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785da05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.627570:0:10363:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785da05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.627595:0:10363:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785da05 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.627603:0:10363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785da05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127449.627656:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771604480:12345-192.168.206.48@tcp:1:lfs.0 Request processed in 15025us (15881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127449.627664:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:0.0:1789127449.633505:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127449.634460:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771604992 00000100:00100000:2.0:1789127449.634472:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771604992 00000100:00100000:2.0:1789127449.634550:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1789127449.634561:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:11425:x1876035771604992:12345-192.168.206.48@tcp:35:lfs.0 00000004:00010000:2.0:1789127449.634617:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785d9f7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc42 expref: 22 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789127449.634830:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1789127449.634878:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789127449.635494:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1789127449.635617:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.635633:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785d99c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc18 expref: 26 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.635642:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.635682:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785d99c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc18 expref: 26 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.635697:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785d99c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc18 expref: 26 pid: 9447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127449.635712:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934687b75680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1876035789529984:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127449.635853:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127449.639061:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127449.639096:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771605120 00000100:00100000:3.0:1789127449.639105:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771605120 00010000:00010000:3.0:1789127449.639142:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785d99c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc18 expref: 27 pid: 9447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127449.639196:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:3.0:1789127449.639218:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:2402:x1876035771605120:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127449.639234:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127449.639241:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785d99c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc18 expref: 27 pid: 9447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.639253:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785d99c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc18 expref: 27 pid: 9447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.639274:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218200) 00010000:00010000:3.0:1789127449.639279:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.639287:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.639294:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.639310:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127449.639350:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:2402:x1876035771605120:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 146us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127449.639358:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 66 00010000:00010000:2.0:1789127449.641331:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785d99c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc18 expref: 26 pid: 9447 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127449.641354:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934687b75680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1876035789529984:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127449.641377:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.641388:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.641394:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789127449.641491:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:2.0:1789127449.641673:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1789127449.641769:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934687b75680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1876035789530112:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789127449.641825:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127449.641860:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127449.642133:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789530112 00000100:00100000:3.0:1789127449.642140:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789530112 00000100:00100000:3.0:1789127449.642359:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789127449.642369:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6526:x1876035789530112:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789127449.642461:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6526:x1876035789530112:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 94us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127449.642469:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789127449.642548:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934687b75680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1876035789530112:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789127449.642687:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:0.0:1789127449.642735:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93468528e1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1876035789530240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789127449.642764:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127449.642945:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dd2300 going to sleep for 11 seconds 00000100:00100000:1.0:1789127449.643191:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789530240 00000100:00100000:1.0:1789127449.643197:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789530240 00000100:00100000:1.0:1789127449.643367:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789127449.643376:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1876035789530240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789127449.643493:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6526:x1876035789530240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 118us (727us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789127449.643500:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789127449.643639:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93468528e1c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1876035789530240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789127449.643680:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1789127449.643714:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.643725:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.643733:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.643739:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7a00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127449.643753:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.643762:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.643777:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218200) 00010000:00010000:0.0:1789127449.643781:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789127449.643785:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127449.643791:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da0c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789127449.643893:0:6526:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789127449.644077:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789127449.644089:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410836578628ns, next at 411836576033ns, rc = 0 00000001:00080000:0.0:1789127449.644095:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:0.0:1789127449.644116:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218200) 00010000:00010000:0.0:1789127449.644119:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789127449.644125:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785d9f7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc42 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127449.644228:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:11425:x1876035771604992:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 9668us (10731us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1789127449.644236:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000020:00080000:0.0:1789127449.644240:0:6526:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789127449.650370:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127449.653615:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771605248 00000100:00100000:2.0:1789127449.653646:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771605248 00000100:00100000:2.0:1789127449.653757:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:2.0:1789127449.653768:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:11425:x1876035771605248:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789127449.653790:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127449.653813:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785da13 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc49 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.653869:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785da13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc49 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.653884:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785da13 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc49 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.653901:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:2.0:1789127449.653918:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789127449.653922:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6200, rc 0) 00000100:00100000:2.0:1789127449.653986:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+30:11425:x1876035771605248:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 220us (3624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127449.653993:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:3.0:1789127449.663616:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127449.663899:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771605504 00000100:00100000:1.0:1789127449.663921:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771605504 00000100:00100000:1.0:1789127449.663975:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:1.0:1789127449.663986:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1ba8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+30:11425:x1876035771605504:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1789127449.664603:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1ba8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+31:11425:x1876035771605504:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 615us (993us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1789127449.664613:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:0.0:1789127449.777768:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127449.778694:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771605760 00000100:00100000:2.0:1789127449.778705:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771605760 00000100:00100000:2.0:1789127449.778780:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:2.0:1789127449.778790:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+31:11435:x1876035771605760:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789127449.778814:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127449.778835:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785da1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc50 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127449.778929:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789127449.779033:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785da1a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc50 expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.779047:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346b7218d00) 00010000:00010000:2.0:1789127449.779050:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127449.779055:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785da1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc50 expref: 33 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.779069:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6000, rc 0) 00000100:00100000:2.0:1789127449.779132:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+32:11435:x1876035771605760:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 343us (1373us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1789127449.779140:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:0.0:1789127449.783663:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127449.784024:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771605888 00000100:00100000:3.0:1789127449.784034:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771605888 00000100:00100000:3.0:1789127449.784089:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:3.0:1789127449.784099:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+32:11435:x1876035771605888:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:3.0:1789127449.784169:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da28 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.784186:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.784199:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.784658:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da2f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.784786:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.784796:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.784868:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785da36 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.784876:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785da36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.784893:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785da36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127449.784939:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785da36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.784951:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da28 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.784958:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da28 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.784964:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.784970:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127449.784974:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.784982:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da28 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.784994:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:3.0:1789127449.784996:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127449.785001:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785006:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785019:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da2f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785030:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da2f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785036:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785040:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ffa00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127449.785043:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da2f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785050:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da2f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785058:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9346b7218100) 00010000:00010000:3.0:1789127449.785060:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127449.785063:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da2f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785069:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da2f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785078:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785da36 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785084:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785da36 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785090:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785da36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785096:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127449.785104:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785da36 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785111:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785da36 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785119:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:3.0:1789127449.785121:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127449.785124:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785da36 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127449.785130:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785da36 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127449.785315:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+32:11435:x1876035771605888:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 1215us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127449.785324:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:3.0:1789127449.796623:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127449.797309:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771606144 00000100:00100000:0.0:1789127449.797318:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771606144 00000100:00100000:0.0:1789127449.797376:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:0.0:1789127449.797385:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+32:11435:x1876035771606144:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1789127449.797627:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+33:11435:x1876035771606144:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 242us (1012us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789127449.797635:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:0.0:1789127449.845128:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127449.845322:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771606400 00000100:00100000:2.0:1789127449.845332:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771606400 00000100:00100000:2.0:1789127449.845390:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:2.0:1789127449.845401:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+33:11438:x1876035771606400:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789127449.845429:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127449.845451:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785da3d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc57 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845559:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785da44 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845574:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785da44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845585:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785da44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845613:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da4b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845627:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845634:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845734:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785da52 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845742:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785da52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845749:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785da52 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127449.845757:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789127449.845818:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785da44 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845825:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785da44 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845831:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785da44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845837:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7e00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127449.845840:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785da44 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845856:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785da44 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845867:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:2.0:1789127449.845870:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127449.845874:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785da44 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845880:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785da44 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845892:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da4b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845897:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da4b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845902:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845907:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6c00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127449.845910:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da4b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845915:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da4b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845922:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9346b7218100) 00010000:00010000:2.0:1789127449.845925:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127449.845927:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da4b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845942:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da4b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845979:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785da3d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc57 expref: 36 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.845992:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785da52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc57 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.846000:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:2.0:1789127449.846003:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127449.846005:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7c00, rc 0) 00000100:00100000:2.0:1789127449.846467:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+35:11438:x1876035771606400:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1066us (1345us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1789127449.846476:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:3.0:1789127449.848686:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127449.848762:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771606528 00000100:00100000:2.0:1789127449.848769:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771606528 00000100:00100000:2.0:1789127449.848817:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:2.0:1789127449.848826:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+35:11438:x1876035771606528:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:2.0:1789127449.848881:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.848897:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.848908:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.848954:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.848961:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da60 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.848968:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.848974:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7a00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127449.848978:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.848985:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da60 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.848995:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:2.0:1789127449.848999:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127449.849003:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da60 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127449.849008:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127449.849085:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+35:11438:x1876035771606528:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 259us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127449.849092:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:3.0:1789127449.851187:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127449.851272:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771606784 00000100:00100000:0.0:1789127449.851280:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771606784 00000100:00100000:0.0:1789127449.851326:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1789127449.851336:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+35:11438:x1876035771606784:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1789127449.851564:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+36:11438:x1876035771606784:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 229us (382us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789127449.851572:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1789127450.081117:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127450.081232:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771607040 00000100:00100000:2.0:1789127450.081242:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771607040 00000100:00100000:2.0:1789127450.081304:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:2.0:1789127450.081329:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+36:11469:x1876035771607040:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:2.0:1789127450.081354:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127450.081376:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc5e expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.081503:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785da6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.081711:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785da6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.081724:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785da6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127450.081737:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789127450.081853:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc5e expref: 39 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.081871:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785da6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc5e expref: 38 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.081880:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:2.0:1789127450.081882:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127450.081886:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6000, rc 0) 00000100:00100000:2.0:1789127450.081984:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:11469:x1876035771607040:12345-192.168.206.48@tcp:101:cat.0 Request processed in 657us (875us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789127450.081993:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:3.0:1789127450.087742:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127450.087781:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127450.087846:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771607168 00000100:00100000:1.0:1789127450.087854:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771607168 00000100:00100000:1.0:1789127450.087920:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1789127450.087930:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:2402:x1876035771607168:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127450.087945:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127450.087967:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785da6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc5e expref: 38 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127450.087983:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:1.0:1789127450.087988:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127450.088077:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771607424 00000100:00100000:2.0:1789127450.088081:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771607424 00000100:00100000:2.0:1789127450.088114:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:2.0:1789127450.088121:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:11469:x1876035771607424:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:1.0:1789127450.088846:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856e940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+39:2402:x1876035771607168:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 913us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127450.088857:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:2.0:1789127450.088981:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:11469:x1876035771607424:12345-192.168.206.48@tcp:35:cat.0 Request processed in 860us (1199us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1789127450.088988:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:3.0:1789127450.135185:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127450.135640:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771607680 00000100:00100000:2.0:1789127450.135650:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771607680 00000100:00100000:2.0:1789127450.135800:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:2.0:1789127450.135813:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:11475:x1876035771607680:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:2.0:1789127450.135842:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127450.135845:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789127450.135874:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785d9d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc34 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.135905:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:2.0:1789127450.135910:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127450.135925:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da7c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc65 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.136023:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.136037:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785da52 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc57 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.136046:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.136096:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785da52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc57 expref: 38 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.136109:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785da52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc57 expref: 38 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127450.136123:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934687b74f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789530368:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127450.136231:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346903519c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127450.139380:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934687b74f00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789530368:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127450.139407:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127450.140039:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127450.140726:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771607808 00000100:00100000:2.0:1789127450.140734:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771607808 00010000:00010000:2.0:1789127450.140767:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785da52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc57 expref: 39 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127450.140841:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:2.0:1789127450.140851:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+39:2402:x1876035771607808:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127450.140865:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127450.140871:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785da52 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc57 expref: 39 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.140894:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785da52 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc57 expref: 39 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.140932:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785da52 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc57 expref: 39 pid: 6523 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.140946:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:2.0:1789127450.140951:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.140959:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.140967:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.140995:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127450.141051:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:2402:x1876035771607808:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 201us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127450.141058:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 67 00010000:00010000:0.0:1789127450.141112:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.141119:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127450.141138:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789127450.141287:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785da7c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc65 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.141302:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc65 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.141321:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:0.0:1789127450.141324:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789127450.141326:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6c00, rc 0) 00000100:00100000:0.0:1789127450.141351:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:11475:x1876035771607680:12345-192.168.206.48@tcp:101:dd.0 Request processed in 5542us (6177us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789127450.141359:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:0.0:1789127450.143603:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127450.143728:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771607936 00000100:00100000:3.0:1789127450.143736:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771607936 00000100:00100000:3.0:1789127450.143791:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:3.0:1789127450.143801:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:11475:x1876035771607936:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:3.0:1789127450.143822:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127450.143852:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785da91 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc6c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.143896:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da98 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.143910:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.143921:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da98 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.144025:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785da91 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc6c expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.144043:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc6c expref: 39 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.144052:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:3.0:1789127450.144055:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789127450.144058:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ffa00, rc 0) 00000100:00100000:3.0:1789127450.144111:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e892c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+39:11475:x1876035771607936:12345-192.168.206.48@tcp:101:dd.0 Request processed in 311us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127450.144117:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:1.0:1789127450.147100:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127450.147185:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771608192 00000100:00100000:3.0:1789127450.147196:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771608192 00000100:00100000:3.0:1789127450.147286:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:3.0:1789127450.147297:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588768b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+39:11475:x1876035771608192:12345-192.168.206.48@tcp:36:dd.0 00010000:00010000:3.0:1789127450.147703:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.147733:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.147745:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127450.147793:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1789127450.147815:0:6524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000b9f17a77 reply state 000000006937b89a transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.147827:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.147834:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:3.0:1789127450.147836:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127450.147839:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127450.148160:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588768b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+42:11475:x1876035771608192:12345-192.168.206.48@tcp:36:dd.0 Request processed in 862us (1068us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789127450.148168:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00000020:00080000:3.0:1789127450.148173:0:6524:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789127450.499330:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127450.499490:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771608320 00000100:00100000:3.0:1789127450.499503:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771608320 00000100:00100000:3.0:1789127450.499608:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:3.0:1789127450.499618:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+42:11489:x1876035771608320:12345-192.168.206.48@tcp:101:stat.0 00010000:00010000:3.0:1789127450.499647:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127450.499673:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785daa6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc73 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.499767:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785daad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.499805:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785daad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.499818:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785daad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.499833:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dab4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.499850:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.499857:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.499958:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dabb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.499969:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc65 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.499978:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dabb lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.500018:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc65 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.500042:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc65 expref: 43 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127450.500075:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458856c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789530496:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127450.500302:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127450.505390:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127450.505760:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458856c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789530496:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127450.505798:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dabb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127450.509087:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771608576 00000100:00100000:1.0:1789127450.509107:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771608576 00000100:00100000:1.0:1789127450.509212:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1789127450.509225:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+44:6171:x1876035771608576:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789127450.509695:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+45:6171:x1876035771608576:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 465us (4313us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1789127450.509705:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1789127450.513658:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127450.513779:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771608704 00000100:00100000:0.0:1789127450.513795:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771608704 00010000:00010000:0.0:1789127450.513850:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc65 expref: 45 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127450.513911:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:0.0:1789127450.513922:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+45:2401:x1876035771608704:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127450.513939:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127450.513945:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc65 expref: 45 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.513960:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc65 expref: 45 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.513982:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785da83 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc65 expref: 45 pid: 6522 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.514000:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:0.0:1789127450.514020:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dabb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.514031:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dabb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.514039:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dabb lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.514070:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127450.514135:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+44:2401:x1876035771608704:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 214us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127450.514143:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00010000:00010000:3.0:1789127450.514229:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dabb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514244:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dabb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127450.514314:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789127450.514320:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127450.514373:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dabb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514389:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dabb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514400:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785daad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514407:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785daad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514416:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785daad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514421:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127450.514437:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785daad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514459:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785daad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514475:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:3.0:1789127450.514478:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127450.514484:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785daad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514491:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785daad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514566:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dab4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514575:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dab4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514582:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dab4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514588:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1c00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127450.514591:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dab4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514597:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dab4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514606:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9346b7218100) 00010000:00010000:3.0:1789127450.514608:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127450.514618:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dab4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514624:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dab4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514670:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785daa6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc73 expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514688:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dabb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc73 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127450.514696:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:3.0:1789127450.514699:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127450.514702:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a1000, rc 0) 00000100:00100000:3.0:1789127450.514760:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+43:11489:x1876035771608320:12345-192.168.206.48@tcp:101:stat.0 Request processed in 15143us (15446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127450.514770:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00010000:00010000:1.0:1789127450.552127:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127450.625823:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127450.626231:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771608960 00000100:00100000:0.0:1789127450.626241:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771608960 00000100:00100000:0.0:1789127450.626300:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:0.0:1789127450.626310:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+43:11495:x1876035771608960:12345-192.168.206.48@tcp:36:truncate.0 00010000:00010000:0.0:1789127450.626364:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127450.626388:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dabb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc73 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.626407:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:0.0:1789127450.626412:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127450.626647:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dac2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.626662:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dac2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.626672:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dac2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789127450.626725:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1789127450.626750:0:6522:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e8f5cb1a reply state 00000000ee8c17a5 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dac2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.626763:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dac2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.626769:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:0.0:1789127450.626772:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127450.626775:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127450.626910:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+45:11495:x1876035771608960:12345-192.168.206.48@tcp:36:truncate.0 Request processed in 601us (1096us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789127450.626919:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00000020:00080000:0.0:1789127450.626924:0:6522:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789127450.788796:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127450.789176:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771609088 00000100:00100000:0.0:1789127450.789189:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771609088 00000100:00100000:0.0:1789127450.789272:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:0.0:1789127450.789283:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588769a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+45:11509:x1876035771609088:12345-192.168.206.48@tcp:101:stat.0 00010000:00010000:0.0:1789127450.789311:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127450.789337:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785dac9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc7a expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789411:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dad0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789428:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789453:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789484:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dad7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789492:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789498:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789632:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dade lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789641:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789649:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127450.789697:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789127450.789703:0:9447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127450.789729:0:9447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789743:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dade lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789753:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dad0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789760:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dad0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789777:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dad0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789783:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127450.789788:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dad0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789796:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dad0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789810:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:0.0:1789127450.789814:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127450.789819:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dad0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789826:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dad0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789841:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dad7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789848:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dad7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789854:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.789987:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127450.789991:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dad7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.790008:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dad7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.790017:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9346b7218100) 00010000:00010000:0.0:1789127450.790020:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127450.790023:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dad7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.790028:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dad7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.790060:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785dac9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc7a expref: 47 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.790076:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc7a expref: 46 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127450.790083:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:0.0:1789127450.790085:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127450.790088:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fecc00, rc 0) 00000100:00100000:0.0:1789127450.790175:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588769a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+46:11509:x1876035771609088:12345-192.168.206.48@tcp:101:stat.0 Request processed in 893us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127450.790184:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:0.0:1789127450.932470:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127450.932737:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771609344 00000100:00100000:2.0:1789127450.932750:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771609344 00000100:00100000:2.0:1789127450.932829:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:2.0:1789127450.932841:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+46:11519:x1876035771609344:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789127450.932879:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127450.932908:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dae5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc81 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127450.933037:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1789127450.933165:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dae5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc81 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.933198:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346b7218d00) 00010000:00010000:2.0:1789127450.933211:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127450.933219:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dae5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc81 expref: 48 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127450.933236:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7c00, rc 0) 00000100:00100000:2.0:1789127450.933315:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+47:11519:x1876035771609344:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 477us (861us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1789127450.933323:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:1.0:1789127450.937918:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127450.938030:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771609600 00000100:00100000:2.0:1789127450.938046:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771609600 00000100:00100000:1.0:1789127450.938573:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:1.0:1789127450.938597:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+47:11519:x1876035771609600:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1789127450.938818:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+48:11519:x1876035771609600:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 233us (907us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1789127450.938826:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:0.0:1789127451.012847:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127451.014316:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771609856 00000100:00100000:2.0:1789127451.014334:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771609856 00000100:00100000:2.0:1789127451.015048:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:2.0:1789127451.015065:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+48:11525:x1876035771609856:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1789127451.015096:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127451.015124:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785daf3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc88 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.015276:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.015295:0:9447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dade lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc7a expref: 49 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.015305:0:9447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.015365:0:9447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc7a expref: 49 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.015381:0:9447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dade lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc7a expref: 49 pid: 9447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127451.015397:0:9447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934687b74f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9447:1876035789530624:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127451.015555:0:9447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346903519c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789127451.019595:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127451.020986:0:9447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934687b74f00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9447:1876035789530624:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127451.021022:0:9447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127451.023288:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127451.026043:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771609984 00000100:00100000:3.0:1789127451.026063:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771609984 00010000:00010000:3.0:1789127451.026130:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dade lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc7a expref: 50 pid: 9447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127451.026188:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:3.0:1789127451.026209:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+50:2402:x1876035771609984:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127451.026229:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127451.026237:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dade lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc7a expref: 50 pid: 9447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.026278:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dade lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc7a expref: 50 pid: 9447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.026311:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dade lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc7a expref: 50 pid: 9447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.026330:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:3.0:1789127451.026336:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.026346:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.026355:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.026597:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127451.026685:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+49:2402:x1876035771609984:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 487us (3409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127451.026693:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00010000:00010000:0.0:1789127451.027413:0:9447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.027439:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127451.027463:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789127451.027652:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785daf3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc88 expref: 50 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.027671:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc88 expref: 49 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.027678:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:0.0:1789127451.027681:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789127451.027684:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7800, rc 0) 00000100:00100000:0.0:1789127451.027728:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+49:11525:x1876035771609856:12345-192.168.206.48@tcp:101:bash.0 Request processed in 12668us (14895us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1789127451.028379:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:0.0:1789127451.032113:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127451.033107:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771610240 00000100:00100000:3.0:1789127451.033123:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771610240 00000100:00100000:3.0:1789127451.033217:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:3.0:1789127451.033229:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+49:11525:x1876035771610240:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:3.0:1789127451.033585:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785db08 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.033607:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785db08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.033640:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785db08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127451.033695:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:3.0:1789127451.033721:0:6524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ec6f0369 reply state 00000000ec829d71 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785db08 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.034079:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785db08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.034090:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:3.0:1789127451.034093:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127451.034098:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127451.034477:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+52:11525:x1876035771610240:12345-192.168.206.48@tcp:36:bash.0 Request processed in 1246us (2379us total) trans 4294967345 rc 0/0 00000100:00100000:3.0:1789127451.034486:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00000020:00080000:3.0:1789127451.034493:0:6524:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789127451.040701:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127451.040813:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771610368 00000100:00100000:3.0:1789127451.040823:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771610368 00000100:00100000:3.0:1789127451.040895:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:3.0:1789127451.040906:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+52:11525:x1876035771610368:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1789127451.040929:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127451.040948:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785db0f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc8f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.041049:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785db16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.041064:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc88 expref: 53 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.041079:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785db16 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.041109:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc88 expref: 53 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.041123:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc88 expref: 53 pid: 9447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127451.041136:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458856d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789530752:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127451.041226:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127451.046062:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458856d680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789530752:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127451.046116:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785db16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127451.054809:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127451.054903:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771610496 00000100:00100000:0.0:1789127451.054911:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771610496 00010000:00010000:0.0:1789127451.054947:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc88 expref: 54 pid: 9447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127451.054985:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:0.0:1789127451.054994:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+54:2402:x1876035771610496:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127451.055008:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127451.055014:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc88 expref: 54 pid: 9447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.055051:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc88 expref: 54 pid: 9447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.055072:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dafa lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc88 expref: 54 pid: 9447 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.055088:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:0.0:1789127451.055093:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785db16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.055102:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785db16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.055110:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785db16 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.055136:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127451.055184:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+53:2402:x1876035771610496:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 191us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127451.055191:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 70 00010000:00010000:3.0:1789127451.055832:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785db16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.055841:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785db16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127451.055892:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789127451.055897:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127451.055918:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785db16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.055951:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785db0f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc8f expref: 53 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.055965:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785db16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc8f expref: 52 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.055987:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:3.0:1789127451.055990:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127451.055993:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a1200, rc 0) 00000100:00100000:3.0:1789127451.056084:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+52:11525:x1876035771610368:12345-192.168.206.48@tcp:101:bash.0 Request processed in 15181us (15392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127451.056092:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:3.0:1789127451.060071:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127451.060148:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771610752 00000100:00100000:1.0:1789127451.060159:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771610752 00000100:00100000:1.0:1789127451.060232:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:1.0:1789127451.060243:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1bab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+52:11525:x1876035771610752:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:1.0:1789127451.060488:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1bab450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+53:11525:x1876035771610752:12345-192.168.206.48@tcp:35:bash.0 Request processed in 237us (416us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1789127451.060496:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000040:00080000:3.0:1789127451.128318:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789127451.131894:0:14505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789127451.138265:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127451.138304:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127451.138351:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127451.138379:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771611008 00000100:00100000:1.0:1789127451.138392:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127451.138398:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771611008 00000100:00100000:1.0:1789127451.138422:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771611136 00000100:00100000:1.0:1789127451.138433:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771611136 00000100:00080000:2.0:1789127451.138458:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127451.138469:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127451.138552:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:2.0:1789127451.138564:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771611264 00000100:00100000:2.0:1789127451.138573:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771611264 00000100:00100000:1.0:1789127451.138574:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771611136:12345-192.168.206.48@tcp:400:kworker.0 00000100:00080000:2.0:1789127451.138603:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127451.138638:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 308 00000100:00100000:2.0:1789127451.138651:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771611008:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127451.138678:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771611136:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 112us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127451.138688:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:1.0:1789127451.138747:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127451.138751:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771611008:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 79us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127451.138869:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771611392 00000100:00100000:1.0:1789127451.138876:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771611392 00000100:00080000:1.0:1789127451.138911:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127451.138950:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 308 00000100:00100000:3.0:1789127451.139031:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771610880 00000100:00100000:3.0:1789127451.139037:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771610880 00000100:00100000:3.0:1789127451.139069:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 444 00000100:00100000:3.0:1789127451.139157:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2402:x1876035771610880:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127451.139208:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e30450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2402:x1876035771610880:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 122us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127451.139216:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 444 00000100:00100000:1.0:1789127451.141021:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 309 00000100:00100000:1.0:1789127451.141039:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771611264:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127451.141097:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771611264:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 66us (2792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127451.141104:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 309 00000100:00100000:1.0:1789127451.141123:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 310 00000100:00100000:1.0:1789127451.141129:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771611392:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127451.141154:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771611392:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (2409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127451.141159:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 310 00000100:00100000:1.0:1789127451.156605:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127451.156694:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771611648 00000100:00100000:3.0:1789127451.156704:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771611648 00000100:00100000:3.0:1789127451.156771:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:3.0:1789127451.156781:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+53:11535:x1876035771611648:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127451.156805:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127451.156825:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785db1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc96 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127451.156932:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789127451.157026:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785db1d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc96 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.157053:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346b7218d00) 00010000:00010000:3.0:1789127451.157055:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127451.157061:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785db1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc96 expref: 55 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.157073:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a0a00, rc 0) 00000100:00100000:3.0:1789127451.157134:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+54:11535:x1876035771611648:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 355us (538us total) trans 4294967347 rc 301/301 00000100:00100000:3.0:1789127451.157141:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:1.0:1789127451.160079:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127451.160170:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771611776 00000100:00100000:0.0:1789127451.160180:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771611776 00000100:00100000:0.0:1789127451.160249:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:0.0:1789127451.160259:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+54:11535:x1876035771611776:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:0.0:1789127451.160342:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785db2b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160376:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785db2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160388:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785db2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160401:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785db32 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160409:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785db32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160416:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785db32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160491:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785db39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160501:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785db39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160535:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785db39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127451.160584:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785db39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160599:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785db2b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160606:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785db2b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160624:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785db2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160631:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127451.160635:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785db2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160643:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785db2b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160656:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:0.0:1789127451.160659:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127451.160664:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785db2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160671:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785db2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160684:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785db32 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160691:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785db32 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160698:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785db32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160703:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fecc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127451.160706:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785db32 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160722:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785db32 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160731:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9346b7218100) 00010000:00010000:0.0:1789127451.160733:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127451.160737:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785db32 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160743:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785db32 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160752:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785db39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160759:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785db39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160765:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785db39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160770:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127451.160773:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785db39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160778:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785db39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160786:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:0.0:1789127451.160788:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127451.160790:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785db39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.160806:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785db39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127451.160870:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+54:11535:x1876035771611776:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 612us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127451.160878:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:1.0:1789127451.164126:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127451.164278:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771612032 00000100:00100000:2.0:1789127451.164287:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771612032 00000100:00100000:2.0:1789127451.164339:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1789127451.164351:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+54:11535:x1876035771612032:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1789127451.164614:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+55:11535:x1876035771612032:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 264us (494us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789127451.164622:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:1.0:1789127451.192298:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127451.192418:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771612288 00000100:00100000:3.0:1789127451.192428:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771612288 00000100:00100000:3.0:1789127451.192491:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:3.0:1789127451.192501:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+55:11538:x1876035771612288:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127451.192704:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127451.192724:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785db40 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffc9d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.192789:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785db47 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.192802:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785db47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.192813:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785db47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.192822:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785db4e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.192840:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785db4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.192846:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785db4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.192933:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785db55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.192941:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785db55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.192947:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785db55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127451.192955:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789127451.193012:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785db47 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193133:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785db47 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193140:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785db47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193146:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127451.193151:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785db47 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193159:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785db47 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193185:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:3.0:1789127451.193188:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127451.193193:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785db47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193223:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785db47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193238:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785db4e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193244:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785db4e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193249:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785db4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193254:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127451.193257:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785db4e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193263:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785db4e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193270:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9346b7218100) 00010000:00010000:3.0:1789127451.193272:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127451.193275:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785db4e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193280:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785db4e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193327:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785db40 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc9d expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193340:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785db55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc9d expref: 57 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.193348:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:3.0:1789127451.193350:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127451.193353:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe600, rc 0) 00000100:00100000:3.0:1789127451.193411:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+57:11538:x1876035771612288:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 912us (1122us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789127451.193420:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:0.0:1789127451.196279:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127451.198412:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771612416 00000100:00100000:2.0:1789127451.198427:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771612416 00000100:00100000:1.0:1789127451.198733:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127451.198761:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771612544 00000100:00100000:1.0:1789127451.198765:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771612544 00000100:00100000:1.0:1789127451.198805:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1789127451.198814:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9de8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+58:2401:x1876035771612544:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127451.198842:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789127451.198849:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 73 00010000:00010000:1.0:1789127451.198865:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785db55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc9d expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127451.198867:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+58:11538:x1876035771612416:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:1.0:1789127451.198884:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:1.0:1789127451.198889:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127451.198929:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db63 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.198942:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.198957:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127451.198987:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9de8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+57:2401:x1876035771612544:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 173us (257us total) trans 0 rc 0/0 00010000:00010000:2.0:1789127451.198989:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db63 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.198995:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db63 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127451.198995:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00010000:00010000:2.0:1789127451.199001:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.199012:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7e00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127451.199016:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db63 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.199024:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db63 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.199033:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:2.0:1789127451.199035:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127451.199039:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db63 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.199045:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db63 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127451.199076:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+56:11538:x1876035771612416:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 210us (2805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127451.199082:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:0.0:1789127451.201672:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127451.202021:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771612800 00000100:00100000:2.0:1789127451.202030:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771612800 00000100:00100000:2.0:1789127451.202083:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:2.0:1789127451.202094:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+56:11538:x1876035771612800:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1789127451.202629:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+57:11538:x1876035771612800:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 536us (965us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1789127451.202638:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:1.0:1789127451.364416:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127451.364714:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771613056 00000100:00100000:2.0:1789127451.364723:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771613056 00000100:00100000:3.0:1789127451.364975:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:3.0:1789127451.364988:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+57:11556:x1876035771613056:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:3.0:1789127451.365011:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127451.365132:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785db6a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffca4 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.365423:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785db71 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.365438:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785db71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.365450:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785db71 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127451.365478:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789127451.365677:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785db6a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffca4 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.365950:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785db71 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffca4 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127451.365962:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:3.0:1789127451.365965:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789127451.365968:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe600, rc 0) 00000100:00100000:3.0:1789127451.366403:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:11556:x1876035771613056:12345-192.168.206.48@tcp:101:cat.0 Request processed in 1416us (1994us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1789127451.366414:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:0.0:1789127451.396906:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127451.397006:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771613184 00000100:00100000:2.0:1789127451.397032:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771613184 00000100:00100000:2.0:1789127451.397091:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:2.0:1789127451.397101:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:11557:x1876035771613184:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789127451.397123:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127451.397144:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffcab expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.397224:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785db86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.397239:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785db86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.397250:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785db86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127451.397291:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1789127451.397295:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127451.397312:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785db86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.397336:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcab expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.397353:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785db86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcab expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.397361:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:2.0:1789127451.397364:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127451.397367:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7200, rc 0) 00000100:00100000:2.0:1789127451.397430:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:11557:x1876035771613184:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 331us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127451.397438:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:0.0:1789127451.415880:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127451.416698:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771613568 00000100:00100000:1.0:1789127451.416708:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771613568 00000100:00100000:1.0:1789127451.416767:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1789127451.416777:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:11557:x1876035771613568:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1789127451.417493:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11557:x1876035771613568:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 714us (1629us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1789127451.417503:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1789127451.420596:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127451.421135:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771613696 00000100:00100000:0.0:1789127451.421147:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771613696 00000100:00100000:0.0:1789127451.421240:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1789127451.421252:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11557:x1876035771613696:12345-192.168.206.48@tcp:103:lfs.0 00010000:00010000:0.0:1789127451.421267:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789127451.421291:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785db16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc8f expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.421314:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785db71 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffca4 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.421329:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785da13 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc49 expref: 59 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127451.421340:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:0.0:1789127451.421345:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127451.421670:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+58:11557:x1876035771613696:12345-192.168.206.48@tcp:103:lfs.0 Request processed in 419us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127451.421680:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1789127451.427632:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127451.427719:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771613824 00000100:00100000:1.0:1789127451.427729:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771613824 00000100:00100000:1.0:1789127451.427815:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:1.0:1789127451.427825:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+58:11557:x1876035771613824:12345-192.168.206.48@tcp:58:lfs.0 00010000:00010000:1.0:1789127451.427935:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785db8d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127451.427952:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785db8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127451.427976:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785db8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127451.428229:0:6523:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127451.428358:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789127451.428692:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789127451.428779:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+58:11557:x1876035771613824:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 954us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127451.428790:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:1.0:1789127451.469856:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127451.470386:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771613952 00000100:00100000:2.0:1789127451.470397:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771613952 00000100:00100000:2.0:1789127451.470455:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:2.0:1789127451.470465:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+58:11559:x1876035771613952:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789127451.470495:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127451.470549:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785db94 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffcb2 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470609:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db9b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470624:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470635:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470646:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dba2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470653:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470660:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470722:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dba9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470744:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470751:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127451.470791:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789127451.470796:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127451.470813:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470824:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dba9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470832:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db9b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470838:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db9b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470844:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db9b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470850:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7e00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127451.470855:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db9b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470862:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db9b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470873:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:2.0:1789127451.470876:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127451.470887:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470893:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785db9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470905:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dba2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470912:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dba2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470917:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dba2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470922:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127451.470925:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dba2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470931:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dba2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470938:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9346b7218100) 00010000:00010000:2.0:1789127451.470940:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127451.470943:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dba2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470949:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dba2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.470975:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785db94 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcb2 expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.471000:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcb2 expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127451.471007:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:2.0:1789127451.471010:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127451.471027:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7800, rc 0) 00000100:00100000:2.0:1789127451.471081:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fabc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:11559:x1876035771613952:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 618us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127451.471089:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 77 00010000:00010000:3.0:1789127451.577741:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789127452.152099:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789127452.152108:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127452.152147:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789127452.152157:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789127452.152295:0:14502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458856cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14502:1876035789530880:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789127452.152434:0:14502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127452.157978:0:14502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458856cf00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14502:1876035789530880:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789127452.168660:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127452.169018:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771614080 00000100:00100000:3.0:1789127452.169029:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771614080 00000100:00100000:3.0:1789127452.169087:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:3.0:1789127452.169097:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:11570:x1876035771614080:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789127452.169143:0:6522:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789127452.169281:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:11570:x1876035771614080:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 185us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127452.169289:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:1.0:1789127452.181482:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127452.181649:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771614208 00000100:00100000:2.0:1789127452.181658:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771614208 00000100:00100000:2.0:1789127452.181718:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:2.0:1789127452.181729:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:11570:x1876035771614208:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789127452.181795:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dbb0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.181811:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.181825:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184132:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785dbb7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184151:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785dbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184179:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785dbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184220:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785dbbe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184230:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785dbbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184237:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785dbbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127452.184285:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789127452.184289:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127452.184304:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785dbbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184314:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dbb0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184320:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dbb0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184327:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dbb0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184333:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6c00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127452.184337:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dbb0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184344:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dbb0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184361:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4200) 00010000:00010000:2.0:1789127452.184364:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127452.184368:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dbb0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184375:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dbb0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184388:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785dbb7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184393:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785dbb7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184398:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785dbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184404:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7a00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127452.184406:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785dbb7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184412:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785dbb7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184417:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9346b7218c00) 00010000:00010000:2.0:1789127452.184420:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127452.184422:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785dbb7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184427:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785dbb7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184448:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785dbbe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184465:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785dbbe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184471:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785dbbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184489:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127452.184492:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785dbbe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184498:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785dbbe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184505:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:2.0:1789127452.184823:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127452.184829:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785dbbe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.184835:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785dbbe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127452.185040:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:11570:x1876035771614208:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 3309us (3563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127452.185050:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:2.0:1789127452.187500:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127452.187700:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771614464 00000100:00100000:2.0:1789127452.187709:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771614464 00000100:00100000:2.0:1789127452.187771:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:2.0:1789127452.187780:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:11570:x1876035771614464:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127452.187798:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127452.187815:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dbc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffcb9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.187972:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785dbcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.187986:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785dbcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.187996:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785dbcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127452.188006:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789127452.188073:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785dbcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.188081:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785dbcc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.188087:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785dbcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.188092:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7e00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127452.188096:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785dbcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.188103:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785dbcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.188123:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:2.0:1789127452.188126:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127452.188131:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785dbcc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.188138:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785dbcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.188173:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dbc5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcb9 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.188183:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4200) 00010000:00010000:2.0:1789127452.188186:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127452.188189:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dbc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcb9 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.188397:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7c00, rc 0) 00000100:00100000:2.0:1789127452.188646:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:11570:x1876035771614464:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 865us (1150us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1789127452.188654:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:1.0:1789127452.197964:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127452.198098:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771614592 00000100:00100000:3.0:1789127452.198108:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771614592 00000100:00100000:3.0:1789127452.198159:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:3.0:1789127452.198170:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:11570:x1876035771614592:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789127452.198214:0:9447:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789127452.198329:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:11570:x1876035771614592:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 161us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127452.198336:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:2.0:1789127452.207105:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127452.207262:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771614848 00000100:00100000:1.0:1789127452.207271:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771614848 00000100:00100000:1.0:1789127452.207331:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:1.0:1789127452.207341:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:11570:x1876035771614848:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127452.207359:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127452.207362:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789127452.207388:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785db86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcab expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.207417:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:1.0:1789127452.207422:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127452.207435:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dbda lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffcc0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789127452.207841:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789127452.207982:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785dbe1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.207996:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785dbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.208007:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785dbe1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.208059:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dbda lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcc0 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.208073:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785dbe1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcc0 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.208081:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8600) 00010000:00010000:1.0:1789127452.208083:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127452.208086:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c600, rc 0) 00000100:00100000:1.0:1789127452.208150:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11570:x1876035771614848:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 810us (1053us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789127452.210866:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:1.0:1789127452.212938:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127452.213031:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771615104 00000100:00100000:3.0:1789127452.213041:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771615104 00000100:00100000:3.0:1789127452.213090:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00100000:3.0:1789127452.213101:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11570:x1876035771615104:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789127452.213164:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127452.213190:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785dbe1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcc0 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213217:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8600) 00010000:00010000:3.0:1789127452.213226:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127452.213247:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dbef lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213261:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dbef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213280:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dbef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213295:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dbf6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x547b9ef7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213302:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x547b9ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213309:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x547b9ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213350:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dbef lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213357:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dbef lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213364:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dbef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213371:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127452.213375:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dbef lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213383:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dbef lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213404:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:3.0:1789127452.213408:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127452.213411:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dbef lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213425:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dbef lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213435:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dbf6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x547b9ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213442:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dbf6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x547b9ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213448:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dbf6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x547b9ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213453:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127452.213456:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dbf6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x547b9ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213462:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dbf6 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x547b9ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213470:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x547b9ef7 (ffff934587df4b00) 00010000:00010000:3.0:1789127452.213472:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127452.213475:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dbf6 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x547b9ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.213480:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dbf6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x547b9ef7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127452.213583:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:11570:x1876035771615104:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 484us (653us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789127452.213591:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00100000:2.0:1789127452.227367:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127452.230959:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771615232 00000100:00100000:1.0:1789127452.230975:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771615232 00000100:00100000:1.0:1789127452.231045:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:1.0:1789127452.231056:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:11570:x1876035771615232:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127452.231076:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127452.231096:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dbfd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffcc7 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.231148:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785dc04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.231162:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785dc04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.231172:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785dc04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.231284:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dbfd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcc7 expref: 62 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.231301:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785dc04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcc7 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.231309:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8300) 00010000:00010000:1.0:1789127452.231312:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789127452.231320:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858dc00, rc 0) 00000100:00100000:1.0:1789127452.231387:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b74780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11570:x1876035771615232:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 333us (4030us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127452.231395:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:2.0:1789127452.247098:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127452.257569:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771615488 00000100:00100000:0.0:1789127452.257583:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771615488 00000100:00100000:0.0:1789127452.257651:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:0.0:1789127452.257660:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11570:x1876035771615488:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789127452.257732:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc0b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.257748:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.257759:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127452.257916:0:6524:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:0.0:1789127452.257925:0:6524:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 413450415132ns, next at 414450412817ns, rc = 0 00000004:00010000:0.0:1789127452.257972:0:6524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002daf85a1 reply state 000000007bd98189 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc0b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.257985:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.257992:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8300) 00010000:00010000:0.0:1789127452.257994:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789127452.257998:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127452.258092:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+63:11570:x1876035771615488:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 432us (11004us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789127452.258112:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:1.0:1789127452.265143:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127452.266535:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771615616 00000100:00100000:3.0:1789127452.266548:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771615616 00000100:00100000:3.0:1789127452.266603:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:3.0:1789127452.266612:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+63:11570:x1876035771615616:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127452.266635:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127452.266656:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc12 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffcce expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.266709:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcce expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.266724:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcce expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.266742:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8300) 00010000:00010000:3.0:1789127452.266745:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127452.266748:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a0a00, rc 0) 00000100:00100000:3.0:1789127452.266810:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+64:11570:x1876035771615616:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 199us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127452.266817:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:0.0:1789127452.303063:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127452.303146:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771615744 00000100:00100000:1.0:1789127452.303156:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771615744 00000100:00100000:1.0:1789127452.303223:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:1.0:1789127452.303231:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2398:x1876035771615744:12345-192.168.206.48@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789127452.303264:0:8439:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp t0 exp 0000000000000000 cur 413 last 0 00000020:00000080:1.0:1789127452.303300:0:8439:0:(genops.c:1385:class_connect()) connect: client 2eecd753-97f2-4dc9-9442-17e5ef8fda22, cookie 0xd718aadfd785dc19 00002000:00100000:1.0:1789127452.303311:0:8439:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2eecd753-97f2-4dc9-9442-17e5ef8fda22/ffff9345887f1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789127452.303328:0:8439:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789127452.303408:0:8439:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789127452.303435:0:8439:0:(import.c:65:import_set_state_nolock()) ffff9345887f1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127452.303499:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2398:x1876035771615744:12345-192.168.206.48@tcp:8:lhsmtool_posix.0 Request processed in 267us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127452.303533:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:3.0:1789127452.316422:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127452.316499:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771615872 00000100:00100000:2.0:1789127452.316533:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771615872 00000100:00100000:2.0:1789127452.316600:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:2.0:1789127452.316610:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:0:x1876035771615872:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789127452.316969:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789127452.332668:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:2.0:1789127452.332686:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000100:00100000:0.0:1789127452.332895:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:0:x1876035771615872:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 16281us (16476us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789127452.332907:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:0.0:1789127452.349733:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127452.352641:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771616128 00000100:00100000:3.0:1789127452.352656:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771616128 00000100:00100000:0.0:1789127452.354661:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:0.0:1789127452.354675:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+64:11570:x1876035771616128:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789127452.354891:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+65:11570:x1876035771616128:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 219us (5170us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1789127452.354899:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000001:00080000:0.0:1789127452.357583:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1789127452.357598:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:0.0:1789127452.357669:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789127452.357686:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff934586dd2cc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789127452.357691:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93469134f800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff934586dd26c0 00000020:00080000:0.0:1789127452.357694:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93469134fc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93469a7dc200 00010000:00010000:2.0:1789127452.357786:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785d94f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357797:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785d94f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357804:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785d94f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357811:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127452.357816:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785d94f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357823:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785d94f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357839:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff934587df4400) 00010000:00010000:2.0:1789127452.357843:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127452.357848:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785d94f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357854:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785d94f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357873:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785d956 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357880:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785d956 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357901:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785d956 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357906:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127452.357908:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785d956 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357913:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785d956 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357922:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:2.0:1789127452.357924:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127452.357927:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785d956 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357932:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785d956 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357948:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785d995 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357954:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785d995 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357959:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785d995 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357964:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6e00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127452.357967:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785d995 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357983:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785d995 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.357991:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9346b7218100) 00010000:00010000:2.0:1789127452.357993:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127452.357996:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785d995 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358001:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785d995 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358016:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358023:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358028:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358033:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127452.358036:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358042:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358049:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:2.0:1789127452.358051:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127452.358054:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da9f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358068:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785da9f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358079:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dac2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358085:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dac2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358090:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dac2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358095:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fedc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127452.358098:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dac2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358103:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dac2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358111:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:2.0:1789127452.358112:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127452.358115:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dac2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358120:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dac2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358129:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785db08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358134:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785db08 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358146:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785db08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358151:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1c00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127452.358153:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785db08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358173:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785db08 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358182:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:2.0:1789127452.358184:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127452.358187:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785db08 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358206:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785db08 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358219:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc0b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358226:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc0b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358232:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358237:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127452.358240:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc0b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358256:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc0b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358265:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8300) 00010000:00010000:2.0:1789127452.358267:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789127452.358271:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc0b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358276:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc0b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127452.358379:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127452.358406:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934687b76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789531008:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789127452.358469:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127452.358551:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789531008 00000100:00100000:2.0:1789127452.358559:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789531008 00000100:00100000:2.0:1789127452.358609:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789127452.358618:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789531008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789127452.358641:0:8440:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1789127452.358668:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa3eb18, atime: 0x6aa3eb18, ctime: 0x6aa3eb18, blocks: 0x8 00010000:00010000:2.0:1789127452.358674:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd16e56/0xd718aadfd785dc20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358686:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=413s v=(0 0) 00010000:00010000:2.0:1789127452.358691:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127452.358697:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd16e56/0xd718aadfd785dc20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358722:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afd16e56/0xd718aadfd785dc20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358731:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd16e56/0xd718aadfd785dc20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358738:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afd16e56/0xd718aadfd785dc20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358755:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789127452.358886:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b770c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3653:x1876035789531008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 269us (417us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789127452.358894:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1789127452.358919:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127452.358925:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afd16e56/0xd718aadfd785dc20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358932:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6000 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127452.358935:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd16e56/0xd718aadfd785dc20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358943:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd16e56/0xd718aadfd785dc20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358956:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afd16e56/0xd718aadfd785dc20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358970:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afd16e56/0xd718aadfd785dc20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.358984:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127452.358986:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127452.358988:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789127452.359014:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff934687b76580/2, rc 0, transno 4294967302 00000100:00100000:2.0:1789127452.359020:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934687b76580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789531008:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1789127452.359323:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1789127452.359464:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00080000:3.0:1789127452.359473:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127452.359596:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458856f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789531136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789127452.359629:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127452.359922:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789531136 00000100:00100000:3.0:1789127452.359935:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789531136 00000100:00100000:3.0:1789127452.360019:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789127452.360027:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b75a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789531136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789127452.360349:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b75a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789531136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 322us (718us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789127452.360358:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789127452.363401:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789127452.366541:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93458856f0c0/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789127452.366555:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458856f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789531136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789127452.384087:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127452.384135:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771616384 00000100:00100000:0.0:1789127452.384143:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771616384 00000100:00100000:0.0:1789127452.384286:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:0.0:1789127452.384297:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+13:11570:x1876035771616384:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789127452.384738:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+13:11570:x1876035771616384:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 441us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127452.384758:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:0.0:1789127452.392261:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000040:00080000:3.0:1789127452.397592:0:14912:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789127452.397602:0:14912:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127452.397631:0:14912:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789127452.397639:0:14912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789127452.399338:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771616512 00000100:00100000:2.0:1789127452.399351:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771616512 00000100:00100000:2.0:1789127452.399420:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:2.0:1789127452.399429:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+13:11570:x1876035771616512:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127452.399446:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127452.399465:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785dc27 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffcd5 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.399560:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785dc2e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.399575:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785dc2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.399598:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785dc2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127452.399645:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127452.399665:0:6522:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785dc2e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.399690:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785dc27 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcd5 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.399707:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785dc2e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcd5 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.399716:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8300) 00010000:00010000:2.0:1789127452.399719:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789127452.399723:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6e00, rc 0) 00000100:00100000:2.0:1789127452.399783:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:11570:x1876035771616512:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 355us (7531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127452.399791:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:0.0:1789127452.411222:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127452.411474:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771616640 00000100:00100000:1.0:1789127452.411483:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771616640 00000100:00100000:1.0:1789127452.411563:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:1.0:1789127452.411573:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771616640:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127452.411590:0:10363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127452.411611:0:10363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffd04e55/0xd718aadfd785dc35 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffcdc expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127452.411634:0:10363:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3eb1b, blocks: 0x0 00010000:00010000:1.0:1789127452.411652:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=413s v=(0 0) 00010000:00010000:1.0:1789127452.411657:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127452.411666:0:10363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffd04e55/0xd718aadfd785dc35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcdc expref: 6 pid: 10363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.411687:0:10363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ffd04e55/0xd718aadfd785dc35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcdc expref: 6 pid: 10363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.411700:0:10363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c000, rc 0) 00000100:00100000:1.0:1789127452.411761:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771616640:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 190us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127452.411768:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:3.0:1789127452.440407:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127452.440489:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771616896 00000100:00100000:0.0:1789127452.440499:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771616896 00000100:00100000:0.0:1789127452.440584:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 89 00000100:00100000:0.0:1789127452.440595:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:11570:x1876035771616896:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789127452.440716:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:11570:x1876035771616896:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 123us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127452.440724:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 89 00000100:00100000:0.0:1789127452.463816:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127452.463882:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771617024 00000100:00100000:2.0:1789127452.463891:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771617024 00000100:00100000:2.0:1789127452.463938:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:2.0:1789127452.463948:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:11570:x1876035771617024:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127452.463965:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127452.463984:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afd16e56/0xd718aadfd785dc3c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffce3 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.464028:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ffd04e55/0xd718aadfd785dc35 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcdc expref: 7 pid: 10363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.464037:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127452.464041:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127452.464045:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afd16e56/0xd718aadfd785dc3c lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffce3 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.464075:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ffd04e55/0xd718aadfd785dc35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcdc expref: 7 pid: 10363 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.464089:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ffd04e55/0xd718aadfd785dc35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcdc expref: 7 pid: 10363 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127452.464103:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934687b761c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1876035789531264:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127452.464187:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351240 going to sleep for 11 seconds 00000100:00100000:0.0:1789127452.478544:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127452.479338:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934687b761c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1876035789531264:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127452.479370:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000afd16e56/0xd718aadfd785dc3c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffce3 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.479390:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6000, rc 0) 00000100:00100000:1.0:1789127452.479442:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:11570:x1876035771617024:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 15496us (15636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127452.479451:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:3.0:1789127452.485597:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771617152 00000100:00100000:3.0:1789127452.485612:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771617152 00010000:00010000:3.0:1789127452.485659:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ffd04e55/0xd718aadfd785dc35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcdc expref: 7 pid: 10363 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127452.485723:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:3.0:1789127452.485734:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771617152:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127452.485749:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127452.485768:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ffd04e55/0xd718aadfd785dc35 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcdc expref: 7 pid: 10363 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.485781:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ffd04e55/0xd718aadfd785dc35 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcdc expref: 7 pid: 10363 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.485803:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffd04e55/0xd718aadfd785dc35 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcdc expref: 7 pid: 10363 timeout: 513 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.485834:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127452.485838:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127452.485847:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000afd16e56/0xd718aadfd785dc3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffce3 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.485857:0:9539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afd16e56/0xd718aadfd785dc3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffce3 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.485894:0:9539:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000afd16e56/0xd718aadfd785dc3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffce3 expref: 6 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127452.485909:0:9539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458856de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9539:1876035789531392:192.168.206.48@tcp:105: 00000100:00100000:3.0:1789127452.485992:0:9539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346c1f63cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127452.512698:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127452.512736:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771617280 00000100:00100000:1.0:1789127452.512744:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771617280 00002000:00100000:1.0:1789127452.512788:0:8445:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9346b7faad00 x1876035771617280/t0(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:188/0 lens 504/0 e 0 to 0 dl 1789127463 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127452.512799:0:8445:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9346b7faad00 with x1876035771617280 ext(0->8) 00002000:00010000:1.0:1789127452.512804:0:8445:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9346b7faad00 00000100:00100000:1.0:1789127452.512827:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1789127452.512838:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7faad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771617280:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789127452.513730:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7faad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2402:x1876035771617280:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 Request processed in 890us (1034us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789127452.513741:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00002000:00100000:1.0:1789127452.513750:0:8445:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9346b7faad00 x1876035771617280/t4294967304(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:188/0 lens 504/448 e 0 to 0 dl 1789127463 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127452.513773:0:8445:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9346b7faad00 with x1876035771617280 ext(0->8) 00002000:00010000:1.0:1789127452.513779:0:8445:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9346b7faad00 00000100:00100000:3.0:1789127452.513942:0:9539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458856de00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9539:1876035789531392:192.168.206.48@tcp:105: 00010000:00010000:3.0:1789127452.513966:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127452.513997:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2401:x1876035771617152:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 28264us (35460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127452.514006:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:2.0:1789127452.524823:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127452.528693:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771617408 00000100:00100000:3.0:1789127452.528709:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771617408 00000100:00100000:2.0:1789127452.531729:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00100000:2.0:1789127452.531743:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:11570:x1876035771617408:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789127452.531897:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:11570:x1876035771617408:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 157us (7085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127452.531905:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00100000:0.0:1789127452.539120:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127452.539200:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771617536 00000100:00100000:3.0:1789127452.539210:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771617536 00000100:00100000:3.0:1789127452.539270:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:3.0:1789127452.539281:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2400:x1876035771617536:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789127452.540807:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1789127452.540821:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1789127452.540976:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2400:x1876035771617536:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 1693us (1861us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127452.540987:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:0.0:1789127452.546626:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127452.546692:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771617792 00000100:00100000:1.0:1789127452.546702:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771617792 00000100:00100000:1.0:1789127452.546758:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00100000:1.0:1789127452.546769:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:11570:x1876035771617792:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789127452.546819:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127452.546846:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785dc2e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcd5 expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.546863:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8300) 00010000:00010000:1.0:1789127452.546868:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127452.546900:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dc43 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.546913:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dc43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.546922:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dc43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789127452.547041:0:6524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c06e83ad reply state 00000000ad52eb33 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dc43 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.547054:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dc43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.547060:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8300) 00010000:00010000:1.0:1789127452.547077:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789127452.547079:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789127452.547177:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:11570:x1876035771617792:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 408us (558us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1789127452.547184:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00100000:0.0:1789127452.550634:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127452.550699:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771617920 00000100:00100000:3.0:1789127452.550709:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771617920 00000100:00100000:3.0:1789127452.550757:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:3.0:1789127452.550766:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771617920:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789127452.550917:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789127452.550920:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789127450 00002000:00010000:3.0:1789127452.550923:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789127448 00002000:00010000:3.0:1789127452.550925:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789127451 -> 1789127450 00002000:00010000:3.0:1789127452.550927:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789127452.550979:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771617920:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 213us (352us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789127452.550987:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:3.0:1789127452.558233:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127452.558600:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771618176 00000100:00100000:2.0:1789127452.558624:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771618176 00000100:00100000:2.0:1789127452.558689:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 92 00000100:00100000:2.0:1789127452.558701:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:11570:x1876035771618176:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789127452.558768:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.558785:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785dc04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcc7 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.558796:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.558832:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785dc04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcc7 expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.558847:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785dc04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcc7 expref: 15 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127452.558861:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934687b76940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789531520:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127452.558954:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351240 going to sleep for 11 seconds 00000100:00100000:0.0:1789127452.574212:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127452.574247:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771618304 00000100:00100000:0.0:1789127452.574255:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771618304 00000100:00100000:3.0:1789127452.574291:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934687b76940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789531520:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127452.574293:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785dc04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcc7 expref: 16 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.574312:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127452.574323:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:0.0:1789127452.574333:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:2401:x1876035771618304:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127452.574346:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127452.574360:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785dc04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcc7 expref: 16 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.574372:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785dc04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcc7 expref: 16 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.574392:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785dc04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcc7 expref: 16 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.574404:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8300) 00010000:00010000:0.0:1789127452.574409:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.574418:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.574425:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.575306:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.575318:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.575351:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127452.575358:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.575371:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.575377:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.575383:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6c00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127452.575386:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.575393:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.575403:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8300) 00010000:00010000:3.0:1789127452.575406:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00000100:00100000:0.0:1789127452.575408:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:2401:x1876035771618304:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 1074us (1218us total) trans 0 rc 0/0 00010000:00010000:3.0:1789127452.575410:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.575416:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dc4a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127452.575416:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:3.0:1789127452.575457:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:11570:x1876035771618176:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 Request processed in 16759us (17235us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789127452.575466:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 92 00000100:00100000:3.0:1789127452.578958:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127452.580263:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771618432 00000100:00100000:2.0:1789127452.580276:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771618432 00000100:00100000:2.0:1789127452.580363:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:2.0:1789127452.580374:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2399:x1876035771618432:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789127452.580421:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fadf391e/0xd718aadfd785dc51 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.580441:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000afd16e56/0xd718aadfd785dc3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffce3 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.580473:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127452.580477:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127452.580483:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fadf391e/0xd718aadfd785dc51 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.580542:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000afd16e56/0xd718aadfd785dc3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffce3 expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127452.580557:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000afd16e56/0xd718aadfd785dc3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffce3 expref: 7 pid: 8439 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127452.580571:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934687b77c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1876035789531648:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127452.580660:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127452.591338:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127452.591440:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934687b77c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1876035789531648:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127452.591477:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fadf391e/0xd718aadfd785dc51 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127452.591570:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771618560 00000100:00100000:3.0:1789127452.591577:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771618560 00010000:00010000:3.0:1789127452.591613:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000afd16e56/0xd718aadfd785dc3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffce3 expref: 8 pid: 8439 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127452.591670:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:3.0:1789127452.591680:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2402:x1876035771618560:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127452.591694:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127452.591712:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000afd16e56/0xd718aadfd785dc3c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffce3 expref: 8 pid: 8439 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.591724:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000afd16e56/0xd718aadfd785dc3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffce3 expref: 8 pid: 8439 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.591747:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afd16e56/0xd718aadfd785dc3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffce3 expref: 8 pid: 8439 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.591761:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127452.591765:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127452.591771:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fadf391e/0xd718aadfd785dc51 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.591780:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fadf391e/0xd718aadfd785dc51 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.591807:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127452.591874:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771618560:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 182us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127452.591882:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 73 00010000:00010000:1.0:1789127452.591987:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fadf391e/0xd718aadfd785dc51 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.591997:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fadf391e/0xd718aadfd785dc51 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.592017:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fadf391e/0xd718aadfd785dc51 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.592025:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fadf391e/0xd718aadfd785dc51 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.592033:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fadf391e/0xd718aadfd785dc51 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.592041:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6e00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127452.592045:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadf391e/0xd718aadfd785dc51 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.592065:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fadf391e/0xd718aadfd785dc51 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.592077:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fadf391e/0xd718aadfd785dc51 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.592085:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fadf391e/0xd718aadfd785dc51 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127452.592133:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2399:x1876035771618432:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 11760us (13182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127452.592141:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:1.0:1789127452.598564:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:3.0:1789127452.600676:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127452.604032:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771618816 00000100:00100000:0.0:1789127452.604046:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771618816 00000100:00100000:0.0:1789127452.604114:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 93 00000100:00100000:0.0:1789127452.604124:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:11570:x1876035771618816:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789127452.604211:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.604234:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da98 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc6c expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.604243:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.604275:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc6c expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.604289:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc6c expref: 14 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127452.604302:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7f9f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789531776:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127452.604391:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346900ce840 going to sleep for 11 seconds 00000100:00100000:3.0:1789127452.616719:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127452.616858:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7f9f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789531776:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127452.616883:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127452.616908:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771618944 00000100:00100000:1.0:1789127452.616915:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771618944 00010000:00010000:1.0:1789127452.616956:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc6c expref: 15 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127452.616995:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 74 00000100:00100000:1.0:1789127452.617005:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:2401:x1876035771618944:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127452.617020:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127452.617026:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da98 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc6c expref: 15 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.617038:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da98 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc6c expref: 15 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.617070:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785da98 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc6c expref: 15 pid: 6523 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.617086:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:1.0:1789127452.617091:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.617101:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.617109:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127452.617137:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127452.617153:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.617169:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127452.617203:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:2401:x1876035771618944:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 199us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127452.617211:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 74 00010000:00010000:0.0:1789127452.617331:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.617344:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc12 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcce expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.617364:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.617389:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcce expref: 14 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.617400:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc12 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcce expref: 14 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127452.617413:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7f9f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789531904:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127452.617555:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346900cec00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127452.622204:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127452.622286:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7f9f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789531904:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127452.622303:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771619072 00000100:00100000:3.0:1789127452.622309:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771619072 00010000:00010000:0.0:1789127452.622313:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.622343:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc12 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcce expref: 15 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127452.622378:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 75 00000100:00100000:3.0:1789127452.622387:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:2402:x1876035771619072:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127452.622403:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127452.622409:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc12 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcce expref: 15 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.622421:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc12 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcce expref: 15 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.622444:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc12 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcce expref: 15 pid: 6522 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.622458:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8300) 00010000:00010000:3.0:1789127452.622463:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.622473:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.622481:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.622557:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127452.622571:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.622577:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127452.622611:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:2402:x1876035771619072:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 225us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127452.622619:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 75 00000001:00080000:0.0:1789127452.622676:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1789127452.622793:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1789127452.622829:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1789127452.622914:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7f9f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6524:1876035789532032:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789127452.622968:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127452.623006:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127452.623063:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789532032 00000100:00100000:1.0:1789127452.623069:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789532032 00000100:00100000:1.0:1789127452.623108:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789127452.623116:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1876035789532032:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789127452.623209:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6524:x1876035789532032:12345-0@lo:1000:mdt00_002.0 Request processed in 93us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127452.623216:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789127452.623331:0:6524:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789127452.623336:0:6524:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93458856f0c0, transno 4294967303 00000100:00100000:0.0:1789127452.623358:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7f9f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6524:1876035789532032:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789127452.623476:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1789127452.623543:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff9680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6524:1876035789532160:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789127452.623571:0:6524:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127452.623588:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297300 going to sleep for 11 seconds 00000100:00100000:3.0:1789127452.623594:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789532160 00000100:00100000:3.0:1789127452.623598:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789532160 00000100:00100000:3.0:1789127452.623631:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789127452.623638:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6524:x1876035789532160:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789127452.623753:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6524:x1876035789532160:12345-0@lo:1000:mdt00_002.0 Request processed in 115us (180us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789127452.623759:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789127452.623980:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff9680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6524:1876035789532160:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789127452.624010:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624017:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624023:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624042:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127452.624047:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624055:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624067:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8300) 00010000:00010000:0.0:1789127452.624069:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127452.624073:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624079:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dc5f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624112:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785db8d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624118:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785db8d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624124:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785db8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624130:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127452.624132:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785db8d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624138:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785db8d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624146:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:0.0:1789127452.624149:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127452.624151:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785db8d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624354:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785db8d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624378:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624390:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dba9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcb2 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624398:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624429:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dba9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcb2 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.624443:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dba9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcb2 expref: 17 pid: 6524 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127452.624464:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789532288:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127452.624550:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297300 going to sleep for 11 seconds 00000100:00100000:1.0:1789127452.629295:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127452.629487:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771619200 00000100:00100000:3.0:1789127452.629497:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771619200 00010000:00010000:3.0:1789127452.629571:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dba9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcb2 expref: 18 pid: 6524 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127452.629605:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:3.0:1789127452.629615:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9dea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:2401:x1876035771619200:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127452.629628:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127452.629634:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dba9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcb2 expref: 18 pid: 6524 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.629646:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dba9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcb2 expref: 18 pid: 6524 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.629668:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:3.0:1789127452.629672:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.629693:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.629700:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.629719:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127452.629775:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9dea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:2401:x1876035771619200:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 161us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127452.629784:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 76 00010000:00010000:0.0:1789127452.629969:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dba9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcb2 expref: 17 pid: 6524 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127452.629985:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789532288:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127452.630002:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630010:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630016:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630027:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630033:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630040:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630052:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127452.630057:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630064:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630073:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:0.0:1789127452.630076:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127452.630079:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630085:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dc66 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630095:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630100:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630106:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630111:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fecc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127452.630114:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630120:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630136:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9346b7218800) 00010000:00010000:0.0:1789127452.630139:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127452.630142:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127452.630147:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dc58 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127452.630299:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:11570:x1876035771618816:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 26176us (31744us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1789127452.630308:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 93 00000020:00080000:0.0:1789127452.630311:0:6524:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789127452.632799:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789127452.632807:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127452.632825:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789127452.632831:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789127452.647636:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127452.647664:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771619456 00000100:00100000:3.0:1789127452.647672:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771619456 00000100:00100000:3.0:1789127452.647716:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:3.0:1789127452.647724:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:11570:x1876035771619456:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789127452.651181:0:6525:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789127452.651253:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1789127452.651310:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc6d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.651329:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.651341:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc6d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.651360:0:6525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc6d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.651367:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc6d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.651373:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc6d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.651391:0:6525:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789127452.651491:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:11570:x1876035771619456:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 3764us (3859us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789127452.651502:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000020:00080000:3.0:1789127452.651522:0:6525:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789127452.651564:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127452.651571:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc6d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.651578:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0a00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127452.651582:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc6d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.651591:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc6d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.651604:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8300) 00010000:00010000:3.0:1789127452.651607:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789127452.651612:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc6d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.651628:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc6d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127452.651640:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127452.651642:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127452.651643:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127452.983843:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127452.983877:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458856fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789532416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127452.983953:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127452.984165:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789532416 00000100:00100000:3.0:1789127452.984172:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789532416 00000100:00100000:3.0:1789127452.984234:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789127452.984244:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789532416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127452.984290:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1789127452.984454:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789532416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 211us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127452.984462:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789127452.984747:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458856fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789532416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127453.496937:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127453.496957:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789532544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127453.497017:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127453.497085:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789532544 00000100:00100000:0.0:1789127453.497092:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789532544 00000100:00100000:0.0:1789127453.497142:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789127453.497151:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789532544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789127453.497179:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127453.497219:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789532672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127453.497237:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789532544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127453.497247:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1789127453.497268:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127453.497274:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127453.497310:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789532544:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127453.497716:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934687b77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789532800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127453.497750:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127453.497849:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789532800 00000100:00100000:0.0:1789127453.497854:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789532800 00000100:00100000:0.0:1789127453.497910:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789127453.497914:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789532672 00000100:00100000:0.0:1789127453.497920:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1876035789532800:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127453.497932:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789532672 00002000:00000024:0.0:1789127453.497934:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127453.497970:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789127453.497977:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b77c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1876035789532800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127453.497981:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789532672:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127453.497989:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000004:00000024:3.0:1789127453.498007:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789127453.498046:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789532672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127453.498054:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789127453.498092:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789532928:0@lo:400:kworker.0 00000100:00100000:3.0:1789127453.498126:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127453.498153:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789533440:0@lo:400:kworker.0 00000100:00100000:3.0:1789127453.498176:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127453.498224:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789533952:0@lo:400:kworker.0 00000100:00100000:3.0:1789127453.498249:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127453.498266:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789127453.498272:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789533056:0@lo:400:kworker.0 00000100:00100000:2.0:1789127453.498296:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789533312:0@lo:400:kworker.0 00000100:00100000:3.0:1789127453.498297:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127453.498318:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789533568:0@lo:400:kworker.0 00000100:00100000:2.0:1789127453.498336:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127453.498350:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127453.498362:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789533824:0@lo:400:kworker.0 00000100:00100000:3.0:1789127453.498380:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789533440 00000100:00100000:3.0:1789127453.498385:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789533440 00000100:00100000:3.0:1789127453.498410:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789533952 00000100:00100000:3.0:1789127453.498412:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789533952 00000100:00100000:3.0:1789127453.498424:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789533056 00000100:00100000:3.0:1789127453.498427:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789533056 00000100:00100000:3.0:1789127453.498437:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789533312 00000100:00100000:3.0:1789127453.498439:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789533312 00000100:00100000:3.0:1789127453.498453:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789127453.498460:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789533440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127453.498496:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789533440:12345-0@lo:400:kworker.0 Request processed in 36us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127453.498502:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789127453.498543:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789127453.498550:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789533952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127453.498557:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127453.498589:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789533952:12345-0@lo:400:kworker.0 Request processed in 40us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127453.498597:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1789127453.498602:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934687b77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789532800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127453.498612:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789533824 00000100:00100000:3.0:1789127453.498617:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789533824 00000100:00100000:2.0:1789127453.498625:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789127453.498634:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789533184:0@lo:400:kworker.0 00000100:00100000:3.0:1789127453.498654:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789127453.498671:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127453.498674:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789533056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127453.498689:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789533696:0@lo:400:kworker.0 00000100:00100000:3.0:1789127453.498716:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789533056:12345-0@lo:400:kworker.0 Request processed in 46us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127453.498726:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1789127453.498727:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127453.498741:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789533184 00000100:00100000:3.0:1789127453.498746:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789533184 00000100:00100000:2.0:1789127453.498768:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789533568 00000100:00100000:3.0:1789127453.498769:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789127453.498774:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789533568 00000100:00100000:3.0:1789127453.498778:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789533312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127453.498813:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789533696 00000100:00100000:2.0:1789127453.498817:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789533696 00000100:00100000:3.0:1789127453.498821:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789533312:12345-0@lo:400:kworker.0 Request processed in 42us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127453.498829:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1789127453.498843:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789127453.498847:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1789127453.498855:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789533568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127453.498858:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789533824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127453.498908:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789533568:12345-0@lo:400:kworker.0 Request processed in 56us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127453.498910:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789533824:12345-0@lo:400:kworker.0 Request processed in 55us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127453.498924:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789127453.498925:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:3.0:1789127453.498950:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789127453.498954:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789127453.498959:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789533184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127453.498965:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b74b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789533696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127453.498996:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789533184:12345-0@lo:400:kworker.0 Request processed in 39us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127453.499003:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1789127453.499011:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b74b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789533696:12345-0@lo:400:kworker.0 Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127453.499019:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789127453.499046:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789533056:0@lo:400:kworker.0 00000100:00100000:2.0:1789127453.499065:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789533184:0@lo:400:kworker.0 00000100:00100000:3.0:1789127453.499066:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789533568:0@lo:400:kworker.0 00000100:00100000:0.0:1789127453.499542:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789532928 00000100:00100000:0.0:1789127453.499548:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789532928 00000100:00100000:0.0:1789127453.499580:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:0.0:1789127453.499586:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346c1e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789532928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127453.499636:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789533696:0@lo:400:kworker.0 00010000:00080000:3.0:1789127453.500176:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ff92c0 x1876035789533952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127453.500223:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789533952:0@lo:400:kworker.0 00010000:00080000:3.0:1789127453.500239:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ffa580 x1876035789533440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127453.500248:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789533440:0@lo:400:kworker.0 00000100:00080000:3.0:1789127453.500305:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127453.500311:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127453.500313:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127453.503779:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789532672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127453.506858:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346c1e32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789532928:12345-0@lo:400:kworker.0 Request processed in 7262us (8720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127453.506874:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1789127453.508576:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789532928:0@lo:400:kworker.0 00000100:00100000:2.0:1789127453.510844:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789533312:0@lo:400:kworker.0 00000100:00100000:2.0:1789127453.510864:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789533824:0@lo:400:kworker.0 00010000:00010000:1.0:1789127453.625918:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127454.008337:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789534080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127454.008404:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127454.008688:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789534080 00000100:00100000:0.0:1789127454.008695:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789534080 00000100:00100000:0.0:1789127454.008747:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789127454.008758:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789534080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127454.008786:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00080000:3.0:1789127454.009049:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127454.015770:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789534080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7001us (7351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127454.015788:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789127454.015849:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789534208:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127454.015928:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127454.016024:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789534208 00000100:00100000:0.0:1789127454.016032:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789534208 00000100:00100000:0.0:1789127454.016078:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789127454.016089:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789534208:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789127454.016820:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789534080:0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127454.017495:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789127454.017652:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789534208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1564us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127454.017662:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789127454.018049:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789534208:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1789127454.388405:0:14963:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127454.388414:0:14963:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127454.388435:0:14963:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789127454.388441:0:14963:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789127454.594472:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127454.594590:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771619712 00000100:00100000:3.0:1789127454.594601:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771619712 00000100:00080000:1.0:1789127454.594731:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127454.595001:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00100000:3.0:1789127454.595014:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:11590:x1876035771619712:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127454.595035:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127454.595053:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffcea expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.595150:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785dc7b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.595164:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785dc7b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.595176:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785dc7b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127454.595199:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789127454.595309:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dc74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcea expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.595327:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785dc7b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcea expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.595335:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:3.0:1789127454.595338:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789127454.595341:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a1200, rc 0) 00000100:00100000:3.0:1789127454.595403:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:11590:x1876035771619712:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 393us (941us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789127454.595411:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00100000:0.0:1789127454.604982:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127454.605681:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771619840 00000100:00100000:3.0:1789127454.605691:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771619840 00000100:00100000:3.0:1789127454.605750:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 95 00000100:00100000:3.0:1789127454.605761:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:11590:x1876035771619840:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:3.0:1789127454.605832:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dc89 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.605847:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dc89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.605869:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dc89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.605887:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dc90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.605895:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dc90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.605921:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dc90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.605993:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dc97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606001:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dc97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606008:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dc97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127454.606048:0:9447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dc97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606061:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dc89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606068:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dc89 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606074:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dc89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606080:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127454.606084:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dc89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606092:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dc89 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606103:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:3.0:1789127454.606112:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127454.606118:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dc89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606124:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dc89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606137:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dc90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606144:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dc90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606149:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dc90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606154:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1c00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127454.606156:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dc90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606161:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dc90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606168:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff934587df4e00) 00010000:00010000:3.0:1789127454.606171:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127454.606174:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dc90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606380:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dc90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606395:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dc97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606408:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dc97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606415:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dc97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606421:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ffa00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127454.606424:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dc97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606429:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dc97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606437:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4f00) 00010000:00010000:3.0:1789127454.606439:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127454.606442:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dc97 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.606447:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dc97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127454.606756:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:11590:x1876035771619840:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 995us (1781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127454.606765:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 95 00010000:00010000:3.0:1789127454.648958:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127454.649107:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127454.650383:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771620096 00000100:00100000:3.0:1789127454.650394:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771620096 00000100:00100000:3.0:1789127454.650456:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 96 00000100:00100000:3.0:1789127454.650466:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:11593:x1876035771620096:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127454.650496:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127454.650536:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dc9e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffcf1 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650605:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dca5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650620:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dca5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650630:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dca5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650644:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dcac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650651:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dcac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650658:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dcac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650761:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dcb3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650770:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dcb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650778:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dcb3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127454.650788:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789127454.650883:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dca5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650891:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dca5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650897:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dca5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650903:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127454.650907:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dca5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650913:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dca5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650925:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:3.0:1789127454.650928:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127454.650932:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dca5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650937:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dca5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650947:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dcac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650954:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dcac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650959:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dcac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650964:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127454.650973:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dcac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650980:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dcac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650987:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff934587df4f00) 00010000:00010000:3.0:1789127454.650990:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127454.650993:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dcac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.650998:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dcac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.651036:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dc9e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf1 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.651049:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dcb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf1 expref: 22 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.651057:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:3.0:1789127454.651059:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127454.651062:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff000, rc 0) 00000100:00100000:3.0:1789127454.651118:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:11593:x1876035771620096:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 654us (2017us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1789127454.651125:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 96 00000100:00100000:0.0:1789127454.653801:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127454.654273:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771620224 00000100:00100000:3.0:1789127454.654284:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771620224 00000100:00100000:3.0:1789127454.654345:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:3.0:1789127454.654355:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:11593:x1876035771620224:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:3.0:1789127454.654421:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dcc1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.654438:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dcc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.654449:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dcc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.654494:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dcc1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.654502:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dcc1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.654530:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dcc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.654536:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127454.654540:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dcc1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.654548:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dcc1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.654560:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:3.0:1789127454.654563:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127454.654567:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dcc1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.654573:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dcc1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127454.654650:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:11593:x1876035771620224:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 295us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127454.654658:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:3.0:1789127454.657161:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127454.657380:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771620480 00000100:00100000:1.0:1789127454.657390:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771620480 00000100:00100000:1.0:1789127454.657443:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:1.0:1789127454.657453:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1ba9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:11593:x1876035771620480:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1789127454.657683:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1ba9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:11593:x1876035771620480:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 230us (528us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1789127454.657691:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1789127454.717461:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127454.717634:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771620736 00000100:00100000:1.0:1789127454.717645:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771620736 00000100:00100000:1.0:1789127454.717704:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 98 00000100:00100000:1.0:1789127454.717716:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:11108:x1876035771620736:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1789127454.717739:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127454.717771:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785dcc8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffcf8 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.717988:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.718003:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dcb3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf1 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.718012:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.718043:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dcb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf1 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.718056:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dcb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf1 expref: 24 pid: 6522 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127454.718070:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fa9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789534336:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789127454.718167:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341840 going to sleep for 11 seconds 00000100:00100000:1.0:1789127454.723331:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fa9a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789534336:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127454.723359:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127454.732029:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127454.732227:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771620864 00000100:00100000:3.0:1789127454.732236:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771620864 00010000:00010000:3.0:1789127454.732277:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dcb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf1 expref: 25 pid: 6522 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127454.732319:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:3.0:1789127454.732329:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+25:2401:x1876035771620864:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127454.732342:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127454.732349:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dcb3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf1 expref: 25 pid: 6522 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.732362:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dcb3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf1 expref: 25 pid: 6522 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.732383:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dcb3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf1 expref: 25 pid: 6522 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.732397:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:3.0:1789127454.732403:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.732412:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.732432:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.732610:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127454.732672:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:2401:x1876035771620864:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 343us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127454.732681:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 77 00010000:00010000:1.0:1789127454.734741:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.734757:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127454.734799:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789127454.735005:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785dcc8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf8 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.735027:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf8 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.735036:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:2.0:1789127454.735039:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789127454.735042:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858ca00, rc 0) 00000100:00100000:2.0:1789127454.735105:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:11108:x1876035771620736:12345-192.168.206.48@tcp:101:bash.0 Request processed in 17392us (17651us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1789127454.735113:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 98 00000100:00100000:0.0:1789127454.743793:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127454.743932:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771620992 00000100:00100000:3.0:1789127454.743941:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771620992 00000100:00100000:3.0:1789127454.743997:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 99 00000100:00100000:3.0:1789127454.744007:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:11108:x1876035771620992:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1789127454.744027:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127454.744045:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dcdd lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffcff expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.744088:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dce4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.744102:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dce4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.744113:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dce4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.744231:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dcdd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcff expref: 26 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.744247:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dce4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcff expref: 25 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.744262:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:3.0:1789127454.744265:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789127454.744268:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe600, rc 0) 00000100:00100000:3.0:1789127454.744327:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+25:11108:x1876035771620992:12345-192.168.206.48@tcp:101:bash.0 Request processed in 321us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127454.744334:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 99 00000100:00100000:3.0:1789127454.748410:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127454.748503:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771621248 00000100:00100000:0.0:1789127454.748548:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771621248 00000100:00100000:0.0:1789127454.748600:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 100 00000100:00100000:0.0:1789127454.748608:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+25:11108:x1876035771621248:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:0.0:1789127454.748815:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dceb lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.748832:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dceb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.748842:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dceb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789127454.748882:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:0.0:1789127454.748906:0:6523:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009f0bcbaf reply state 0000000040adbaac transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dceb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.748919:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dceb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.748943:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:0.0:1789127454.748945:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127454.748949:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789127454.748988:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:0.0:1789127454.749075:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:11108:x1876035771621248:12345-192.168.206.48@tcp:36:bash.0 Request processed in 467us (674us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789127454.749083:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 100 00000020:00080000:0.0:1789127454.749087:0:6523:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789127454.757869:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127454.757946:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771621376 00000100:00100000:3.0:1789127454.757955:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771621376 00000100:00100000:3.0:1789127454.758012:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 101 00000100:00100000:3.0:1789127454.758021:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:11108:x1876035771621376:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1789127454.758043:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127454.758062:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dcf2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd06 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.758114:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dcf2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd06 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.758127:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dcf2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd06 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.758143:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:3.0:1789127454.758146:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127454.758149:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ffa00, rc 0) 00000100:00100000:3.0:1789127454.758222:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b75e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+30:11108:x1876035771621376:12345-192.168.206.48@tcp:101:bash.0 Request processed in 201us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127454.758244:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 101 00000100:00100000:3.0:1789127454.763474:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127454.763949:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771621504 00000100:00100000:1.0:1789127454.763960:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771621504 00000100:00100000:1.0:1789127454.764050:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:1.0:1789127454.764061:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:11108:x1876035771621504:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1789127454.764077:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127454.764098:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7d9aa78/0xd718aadfd785dcf9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd0d expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127454.764120:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3eb1a, atime: 0x6aa3eb18, ctime: 0x6aa3eb1a, blocks: 0x8 00010000:00010000:1.0:1789127454.764141:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=415s v=(0 0) 00010000:00010000:1.0:1789127454.764146:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127454.764153:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d9aa78/0xd718aadfd785dcf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd0d expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.764170:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f7d9aa78/0xd718aadfd785dcf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd0d expref: 7 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.764194:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858de00, rc 0) 00000100:00100000:1.0:1789127454.764256:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:11108:x1876035771621504:12345-192.168.206.48@tcp:101:bash.0 Request processed in 196us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127454.764263:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00080000:3.0:1789127454.764573:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127454.768298:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127454.768392:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771621632 00000100:00100000:2.0:1789127454.768401:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771621632 00002000:00010000:2.0:1789127454.768439:0:8443:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1789127454.768444:0:8443:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9346b7fa9a40 with x1876035771621632 ext(0->18446744073709551615) 00002000:00010000:2.0:1789127454.768454:0:8443:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9346b7fa9a40. 00000100:00100000:2.0:1789127454.768485:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:2.0:1789127454.768494:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771621632:12345-192.168.206.48@tcp:10:bash.0 00002000:00010000:2.0:1789127454.768797:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1789127454.768801:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789127450 -> 1789127453 00002000:00010000:2.0:1789127454.768803:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789127448 -> 1789127448 00002000:00010000:2.0:1789127454.768805:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789127450 -> 1789127453 00002000:00010000:2.0:1789127454.768807:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1789127454.768870:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2402:x1876035771621632:12345-192.168.206.48@tcp:10:bash.0 Request processed in 376us (578us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789127454.768890:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00002000:00010000:2.0:1789127454.768894:0:8443:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:2.0:1789127454.768897:0:8443:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9346b7fa9a40 with x1876035771621632 ext(0->18446744073709551615) 00002000:00010000:2.0:1789127454.768902:0:8443:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9346b7fa9a40. 00000100:00100000:0.0:1789127454.849797:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127454.849892:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771621760 00000100:00100000:2.0:1789127454.849903:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771621760 00000100:00100000:2.0:1789127454.849961:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 102 00000100:00100000:2.0:1789127454.849971:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+30:11607:x1876035771621760:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:2.0:1789127454.850035:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785dd00 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850052:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785dd00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850065:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785dd00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850262:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dd07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850272:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dd07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850280:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dd07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850353:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dd0e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850363:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dd0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850383:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dd0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127454.850429:0:6522:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dd0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850440:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785dd00 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850446:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785dd00 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850453:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785dd00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850459:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127454.850463:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785dd00 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850471:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785dd00 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850497:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:2.0:1789127454.850500:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127454.850504:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785dd00 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850548:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785dd00 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850561:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dd07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850573:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dd07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850578:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dd07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850583:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127454.850586:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dd07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850592:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dd07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850601:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9346b7218100) 00010000:00010000:2.0:1789127454.850603:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127454.850606:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dd07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850613:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785dd07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850627:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dd0e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850634:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dd0e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850640:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dd0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850645:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7c00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127454.850654:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dd0e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850661:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dd0e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850668:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:2.0:1789127454.850670:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127454.850673:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dd0e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127454.850679:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785dd0e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127454.851167:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+30:11607:x1876035771621760:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 1195us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127454.851176:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 102 00000100:00100000:3.0:1789127454.884622:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127454.884737:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771622016 00000100:00100000:0.0:1789127454.884747:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771622016 00000100:00100000:0.0:1789127454.884806:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 103 00000100:00100000:0.0:1789127454.884817:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+30:11610:x1876035771622016:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127454.884835:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127454.884865:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dd15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd14 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.884933:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785dd1c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.884946:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785dd1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.884957:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785dd1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.884971:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785dd23 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.884996:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785dd23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885003:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785dd23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885101:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dd2a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885112:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dd2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885119:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dd2a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127454.885129:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789127454.885216:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785dd1c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885224:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785dd1c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885231:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785dd1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885237:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127454.885241:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785dd1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885249:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785dd1c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885271:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:0.0:1789127454.885274:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127454.885278:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785dd1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885285:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785dd1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885297:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785dd23 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885303:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785dd23 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885308:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785dd23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885314:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587feda00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127454.885317:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785dd23 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885323:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785dd23 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885330:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9346a69cbe00) 00010000:00010000:0.0:1789127454.885332:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127454.885335:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785dd23 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885340:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785dd23 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885391:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dd15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd14 expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885404:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dd2a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd14 expref: 32 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.885411:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:0.0:1789127454.885413:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789127454.885416:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fedc00, rc 0) 00000100:00100000:0.0:1789127454.885812:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+32:11610:x1876035771622016:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 995us (1198us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1789127454.885821:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 103 00000100:00100000:1.0:1789127454.889283:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127454.889381:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771622144 00000100:00100000:0.0:1789127454.889391:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771622144 00000100:00100000:0.0:1789127454.889489:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 104 00000100:00100000:0.0:1789127454.889499:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+32:11610:x1876035771622144:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:0.0:1789127454.889586:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.889602:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf8 expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.889614:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.889645:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf8 expref: 32 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127454.889676:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf8 expref: 32 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127454.889690:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789534464:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127454.889787:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127454.892755:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127454.892879:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789534464:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127454.892904:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127454.893072:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771622400 00000100:00100000:1.0:1789127454.893091:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771622400 00000100:00100000:1.0:1789127454.893148:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:1.0:1789127454.893157:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+33:6171:x1876035771622400:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789127454.893422:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+34:6171:x1876035771622400:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 264us (675us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789127454.893430:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:1.0:1789127454.896096:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127454.896189:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771622528 00000100:00100000:3.0:1789127454.896197:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771622528 00010000:00010000:3.0:1789127454.896232:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf8 expref: 34 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127454.896273:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:3.0:1789127454.896282:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+34:2401:x1876035771622528:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127454.896295:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127454.896301:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf8 expref: 34 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.896312:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf8 expref: 34 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.896332:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785dccf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcf8 expref: 34 pid: 6522 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.896346:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:3.0:1789127454.896351:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.896361:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.896384:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.896419:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127454.896466:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+33:2401:x1876035771622528:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 184us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127454.896475:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 78 00010000:00010000:1.0:1789127454.896590:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.896598:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.896633:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.896640:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.896647:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.896653:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127454.896657:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.896663:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.896673:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:1.0:1789127454.896676:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127454.896687:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127454.896694:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dd38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127454.896733:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+32:11610:x1876035771622144:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 7235us (7457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127454.896741:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 104 00000100:00100000:2.0:1789127454.899440:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127454.899626:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771622784 00000100:00100000:1.0:1789127454.899635:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771622784 00000100:00100000:1.0:1789127454.899687:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:1.0:1789127454.899696:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690400780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+32:11610:x1876035771622784:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1789127454.900021:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690400780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+33:11610:x1876035771622784:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 324us (588us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789127454.900030:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:2.0:1789127454.975017:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127454.975113:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771623040 00000100:00100000:3.0:1789127454.975123:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771623040 00000100:00100000:3.0:1789127454.975196:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 105 00000100:00100000:3.0:1789127454.975206:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+33:11621:x1876035771623040:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:3.0:1789127454.975231:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127454.975250:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd3f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd1b expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975316:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd46 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975330:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975341:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975356:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd4d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975364:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975388:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975488:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dd54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975497:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dd54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975505:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dd54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127454.975555:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789127454.975625:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd46 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975633:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd46 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975639:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975645:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127454.975649:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd46 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975656:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd46 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975668:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:3.0:1789127454.975671:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127454.975682:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd46 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975689:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd46 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975703:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd4d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975710:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd4d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975716:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975720:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127454.975724:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd4d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975730:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd4d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975738:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff934587df4f00) 00010000:00010000:3.0:1789127454.975740:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127454.975743:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd4d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975750:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd4d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975794:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd3f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd1b expref: 36 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975821:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dd54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd1b expref: 35 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127454.975829:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:3.0:1789127454.975832:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127454.975834:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe800, rc 0) 00000100:00100000:3.0:1789127454.975902:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690400000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+35:11621:x1876035771623040:12345-192.168.206.48@tcp:101:cat.0 Request processed in 696us (893us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789127454.975909:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 105 00000100:00100000:3.0:1789127454.981021:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127454.981100:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771623296 00000100:00100000:0.0:1789127454.981110:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771623296 00000100:00100000:0.0:1789127454.981170:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:0.0:1789127454.981196:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+35:11621:x1876035771623296:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:0.0:1789127454.981468:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+36:11621:x1876035771623296:12345-192.168.206.48@tcp:35:cat.0 Request processed in 273us (454us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789127454.981477:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:2.0:1789127455.000543:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.000621:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771623552 00000100:00100000:3.0:1789127455.000630:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771623552 00000100:00100000:3.0:1789127455.000685:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 106 00000100:00100000:3.0:1789127455.000696:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690400b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+36:11622:x1876035771623552:12345-192.168.206.48@tcp:36:rm.0 00010000:00010000:3.0:1789127455.000748:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1789127455.000774:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785dcf2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd06 expref: 36 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.000793:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785dd54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd1b expref: 35 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.000805:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dd2a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd14 expref: 34 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.000816:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785dce4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcff expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.000842:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:3.0:1789127455.000846:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127455.000878:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd62 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.000891:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.000901:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.000915:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.000922:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.000928:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.000996:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd70 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001005:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd70 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001012:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd70 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127455.001221:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1789127455.001232:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416193721522ns, next at 417193718618ns, rc = 0 00010000:00010000:3.0:1789127455.001281:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd77 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001290:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001298:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd77 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001304:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd77 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001311:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd77 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001317:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd77 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001344:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127455.001361:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd70 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001367:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd70 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001373:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd70 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001378:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127455.001381:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd70 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001389:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd70 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001403:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:3.0:1789127455.001406:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789127455.001410:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd70 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001417:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785dd70 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001433:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd62 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001439:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd62 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001444:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001449:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127455.001452:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd62 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001457:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd62 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001464:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:3.0:1789127455.001466:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127455.001469:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd62 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001483:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd62 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127455.001503:0:6522:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001864f197 reply state 0000000017d2a95c transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001570:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.001576:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff934587df4f00) 00010000:00010000:3.0:1789127455.001579:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127455.001582:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127455.001648:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690400b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+34:11622:x1876035771623552:12345-192.168.206.48@tcp:36:rm.0 Request processed in 953us (1139us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789127455.001656:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 106 00010000:00010000:0.0:1789127455.002209:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127455.002217:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd77 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.002224:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1c00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127455.002227:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd77 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.002235:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd77 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.002258:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:0.0:1789127455.002260:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789127455.002264:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd77 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.002269:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd77 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.002281:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127455.002282:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127455.002284:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127455.056898:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.056979:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771623808 00000100:00100000:3.0:1789127455.056988:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771623808 00000100:00100000:3.0:1789127455.057045:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 107 00000100:00100000:3.0:1789127455.057054:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690402580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+34:11628:x1876035771623808:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1789127455.057075:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127455.057094:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dd7e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd22 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057189:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dd85 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057203:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dd85 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057214:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dd85 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057241:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057248:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057255:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789127455.057536:0:9447:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789127455.057646:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057654:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057661:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057689:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dd85 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057695:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dd85 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057701:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dd85 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057707:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0a00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127455.057711:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dd85 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057728:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dd85 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057739:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:3.0:1789127455.057742:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127455.057746:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dd85 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057752:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785dd85 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127455.057765:0:9447:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000002d01762 reply state 00000000e7f86683 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057775:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057781:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff934587df4f00) 00010000:00010000:3.0:1789127455.057784:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127455.057786:0:9447:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789127455.057812:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785dd7e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd22 expref: 37 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057827:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd22 expref: 36 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.057834:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4000) 00010000:00010000:3.0:1789127455.057836:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127455.057838:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff000, rc 0) 00000100:00100000:3.0:1789127455.057901:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690402580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+37:11628:x1876035771623808:12345-192.168.206.48@tcp:101:bash.0 Request processed in 848us (1011us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789127455.057914:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 107 00000100:00100000:3.0:1789127455.061102:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127455.061212:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771623936 00000100:00100000:2.0:1789127455.061222:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771623936 00000100:00100000:2.0:1789127455.061298:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:2.0:1789127455.061309:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2400:x1876035771623936:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1789127455.061325:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127455.061345:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ad9f389/0xd718aadfd785dda1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd29 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127455.061386:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127455.061404:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=416s v=(0 0) 00010000:00010000:2.0:1789127455.061409:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127455.061418:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ad9f389/0xd718aadfd785dda1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd29 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.061437:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000ad9f389/0xd718aadfd785dda1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd29 expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.061451:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7800, rc 0) 00000100:00100000:2.0:1789127455.061549:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2400:x1876035771623936:12345-192.168.206.48@tcp:101:bash.0 Request processed in 241us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127455.061557:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00080000:3.0:1789127455.061680:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127455.065328:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.065408:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771624064 00000100:00100000:3.0:1789127455.065418:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771624064 00000100:00100000:3.0:1789127455.065470:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:3.0:1789127455.065481:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:11628:x1876035771624064:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1789127455.065496:0:10363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127455.065534:0:10363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd30 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.065562:0:10363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000ad9f389/0xd718aadfd785dda1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd29 expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.065570:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127455.065574:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127455.065579:0:10363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 9 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.065630:0:10363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000ad9f389/0xd718aadfd785dda1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd29 expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.065645:0:10363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000ad9f389/0xd718aadfd785dda1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd29 expref: 9 pid: 8440 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127455.065660:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904061c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10363:1876035789534592:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127455.065765:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127455.068433:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904061c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10363:1876035789534592:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127455.068465:0:10363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 9 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.068603:0:10363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe200, rc 0) 00000100:00100000:3.0:1789127455.068665:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904030c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:11628:x1876035771624064:12345-192.168.206.48@tcp:101:bash.0 Request processed in 3185us (3344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127455.068674:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:0.0:1789127455.071780:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.071945:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771624192 00000100:00100000:3.0:1789127455.071955:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771624192 00010000:00010000:3.0:1789127455.072089:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000ad9f389/0xd718aadfd785dda1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd29 expref: 9 pid: 8440 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127455.072170:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:3.0:1789127455.072196:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2402:x1876035771624192:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127455.072210:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127455.072230:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000ad9f389/0xd718aadfd785dda1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd29 expref: 9 pid: 8440 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.072244:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000ad9f389/0xd718aadfd785dda1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd29 expref: 9 pid: 8440 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.072270:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ad9f389/0xd718aadfd785dda1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd29 expref: 9 pid: 8440 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.072303:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127455.072307:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127455.072315:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 8 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.072325:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 8 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.072360:0:6507:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 8 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127455.072373:0:6507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904061c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6507:1876035789534720:192.168.206.48@tcp:105: 00000100:00100000:3.0:1789127455.072460:0:6507:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127455.075881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127455.076025:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771624448 00000100:00100000:1.0:1789127455.076034:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771624448 00000100:00100000:1.0:1789127455.076089:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:1.0:1789127455.076098:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690401a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+37:11628:x1876035771624448:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:1.0:1789127455.076384:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690401a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:11628:x1876035771624448:12345-192.168.206.48@tcp:35:bash.0 Request processed in 286us (514us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1789127455.076393:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:3.0:1789127455.076629:0:6507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904061c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6507:1876035789534720:192.168.206.48@tcp:105: 00010000:00010000:3.0:1789127455.076652:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127455.076679:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff8f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2402:x1876035771624192:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 4487us (4908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127455.076688:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:2.0:1789127455.224547:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.224609:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771624576 00000100:00100000:3.0:1789127455.224619:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771624576 00000100:00100000:3.0:1789127455.224671:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 108 00000100:00100000:3.0:1789127455.224680:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:11644:x1876035771624576:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127455.224704:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127455.224723:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ddaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd37 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.224790:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785ddb6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.224803:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785ddb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.224813:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785ddb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127455.224860:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789127455.224863:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127455.224880:0:6522:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785ddb6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.224901:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ddaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd37 expref: 40 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.224915:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785ddb6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd37 expref: 39 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.224925:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:3.0:1789127455.224928:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127455.224931:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe800, rc 0) 00000100:00100000:3.0:1789127455.224987:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+39:11644:x1876035771624576:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 308us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127455.224994:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 108 00000100:00100000:1.0:1789127455.228703:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.228875:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771624832 00000100:00100000:3.0:1789127455.228885:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771624832 00000100:00100000:3.0:1789127455.228952:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 109 00000100:00100000:3.0:1789127455.228962:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+39:11644:x1876035771624832:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127455.228981:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127455.229000:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785ddbd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd3e expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.229106:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785ddc4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.229120:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785ddc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.229131:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785ddc4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127455.229142:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789127455.229257:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785ddbd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd3e expref: 42 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.229274:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785ddc4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd3e expref: 41 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.229283:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4000) 00010000:00010000:3.0:1789127455.229285:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127455.229288:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a1000, rc 0) 00000100:00100000:3.0:1789127455.229346:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+41:11644:x1876035771624832:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 385us (650us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1789127455.229354:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 109 00000100:00100000:2.0:1789127455.233090:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127455.233127:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.233203:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771624960 00000100:00100000:3.0:1789127455.233223:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771624960 00000100:00100000:3.0:1789127455.233282:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1789127455.233291:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+41:2400:x1876035771624960:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127455.233305:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127455.233327:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785ddc4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd3e expref: 41 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.233344:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4000) 00010000:00010000:3.0:1789127455.233348:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127455.233400:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+40:2400:x1876035771624960:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 109us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127455.233407:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:0.0:1789127455.234094:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771625216 00000100:00100000:0.0:1789127455.234102:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771625216 00000100:00100000:0.0:1789127455.234140:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 110 00000100:00100000:0.0:1789127455.234147:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690402940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+40:11644:x1876035771625216:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127455.234165:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127455.234194:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddd2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd45 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.234274:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddd9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.234287:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.234297:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddd9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127455.234307:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789127455.234405:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddd2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd45 expref: 43 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.234420:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddd9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd45 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.234428:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4000) 00010000:00010000:0.0:1789127455.234431:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789127455.234434:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec400, rc 0) 00000100:00100000:0.0:1789127455.234485:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690402940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+42:11644:x1876035771625216:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 331us (1350us total) trans 4294967381 rc 0/0 00000100:00100000:0.0:1789127455.234491:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 110 00000100:00100000:2.0:1789127455.241976:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.242055:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771625344 00000100:00100000:3.0:1789127455.242064:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771625344 00000100:00100000:3.0:1789127455.242120:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:3.0:1789127455.242130:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690403c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2401:x1876035771625344:12345-192.168.206.48@tcp:1:lfs.0 00010000:00010000:3.0:1789127455.242174:0:8755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7e62537/0xd718aadfd785dde7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.242205:0:8755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 8 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.242213:0:8755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127455.242217:0:8755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127455.242222:0:8755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e62537/0xd718aadfd785dde7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.242272:0:8755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 8 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.242285:0:8755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 8 pid: 10363 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127455.242300:0:8755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904061c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8755:1876035789534848:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127455.242398:0:8755:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127455.244910:0:8755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904061c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8755:1876035789534848:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127455.244937:0:8755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f7e62537/0xd718aadfd785dde7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127455.246465:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.246810:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771625472 00000100:00100000:3.0:1789127455.246820:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771625472 00002000:00100000:3.0:1789127455.246877:0:8444:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff934690403840 x1876035771625472/t0(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:191/0 lens 504/0 e 0 to 0 dl 1789127466 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789127455.246888:0:8444:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff934690403840 with x1876035771625472 ext(0->8) 00010000:00010000:3.0:1789127455.246897:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 9 pid: 10363 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.246912:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 9 pid: 10363 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127455.246920:0:8444:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff934690403840 00000100:00100000:3.0:1789127455.246953:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:3.0:1789127455.246963:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690403840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2402:x1876035771625472:12345-192.168.206.48@tcp:4:lfs.0 00000100:00100000:3.0:1789127455.251986:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690403840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+11:2402:x1876035771625472:12345-192.168.206.48@tcp:4:lfs.0 Request processed in 5015us (5520us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789127455.252014:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00002000:00100000:3.0:1789127455.252027:0:8444:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff934690403840 x1876035771625472/t4294967303(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:191/0 lens 504/448 e 0 to 0 dl 1789127466 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789127455.252036:0:8444:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff934690403840 with x1876035771625472 ext(0->8) 00010000:00010000:3.0:1789127455.252048:0:8444:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 11 pid: 10363 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.252068:0:8444:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 11 pid: 10363 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127455.252076:0:8444:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff934690403840 00000001:00080000:1.0:1789127455.253463:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:1.0:1789127455.253478:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1789127455.254724:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127455.254823:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771625600 00000100:00100000:0.0:1789127455.254832:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771625600 00010000:00010000:0.0:1789127455.254880:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 7 pid: 10363 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127455.254921:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:0.0:1789127455.254931:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2400:x1876035771625600:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127455.254946:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789127455.254963:0:9539:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789127455.254966:0:9539:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789127454 00002000:00010000:0.0:1789127455.254968:0:9539:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789127454 00002000:00010000:0.0:1789127455.254969:0:9539:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789127454 00002000:00010000:0.0:1789127455.254971:0:9539:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1789127455.254976:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 7 pid: 10363 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.255007:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 7 pid: 10363 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.255029:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d656c5c7/0xd718aadfd785dda8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd30 expref: 7 pid: 10363 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.255044:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127455.255049:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127455.255054:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7e62537/0xd718aadfd785dde7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.255063:0:9539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e62537/0xd718aadfd785dde7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.255101:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127455.255164:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904052c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2400:x1876035771625600:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 235us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127455.255173:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 80 00010000:00010000:2.0:1789127455.255256:0:8755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f7e62537/0xd718aadfd785dde7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.255265:0:8755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7e62537/0xd718aadfd785dde7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.255290:0:8755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f7e62537/0xd718aadfd785dde7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.255298:0:8755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f7e62537/0xd718aadfd785dde7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.255307:0:8755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f7e62537/0xd718aadfd785dde7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.255315:0:8755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0a00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127455.255318:0:8755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7e62537/0xd718aadfd785dde7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.255328:0:8755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f7e62537/0xd718aadfd785dde7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.255341:0:8755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f7e62537/0xd718aadfd785dde7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127455.255349:0:8755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7e62537/0xd718aadfd785dde7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127455.255412:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690403c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771625344:12345-192.168.206.48@tcp:1:lfs.0 Request processed in 13283us (13446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127455.255421:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:1.0:1789127455.263394:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127455.263502:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771625856 00000100:00100000:0.0:1789127455.263551:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771625856 00000100:00100000:0.0:1789127455.263612:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:0.0:1789127455.263622:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1baa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+42:11644:x1876035771625856:12345-192.168.206.48@tcp:35:lfs.0 00000004:00010000:0.0:1789127455.263685:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddd9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd45 expref: 42 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789127455.263881:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1789127455.263916:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789127455.264278:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:0.0:1789127455.264317:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.264333:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd93 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd22 expref: 46 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.264342:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.264376:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd22 expref: 46 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.264390:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd22 expref: 46 pid: 9447 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127455.264403:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1876035789534976:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127455.264482:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dd2300 going to sleep for 11 seconds 00000100:00100000:0.0:1789127455.272110:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1876035789534976:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127455.272138:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127455.272446:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.272731:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771625984 00000100:00100000:3.0:1789127455.272739:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771625984 00010000:00010000:3.0:1789127455.272776:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd22 expref: 47 pid: 9447 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127455.272818:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:3.0:1789127455.272827:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7faa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+47:2401:x1876035771625984:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127455.272840:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127455.272846:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd93 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd22 expref: 47 pid: 9447 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.272858:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd22 expref: 47 pid: 9447 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.272902:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dd93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd22 expref: 47 pid: 9447 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.272917:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4000) 00010000:00010000:3.0:1789127455.272922:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.272930:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.272937:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.272965:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127455.273074:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7faa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+46:2401:x1876035771625984:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 247us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127455.273081:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 81 00010000:00010000:0.0:1789127455.273550:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.273558:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789127455.273672:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:0.0:1789127455.273794:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1789127455.273880:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1876035789535104:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789127455.273950:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127455.273981:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687b13e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127455.275447:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789535104 00000100:00100000:3.0:1789127455.275459:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789535104 00000100:00100000:3.0:1789127455.275554:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789127455.275564:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1876035789535104:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789127455.275672:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6526:x1876035789535104:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 110us (1722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127455.275679:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1789127455.275765:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127455.278756:0:6526:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:0.0:1789127455.278766:0:6526:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:0.0:1789127455.278788:0:6526:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff934687b76580, transno 4294967302 00000100:00100000:0.0:1789127455.278808:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1876035789535104:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789127455.278942:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:0.0:1789127455.279014:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1876035789535232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789127455.279064:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127455.279087:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127455.279328:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789535232 00000100:00100000:1.0:1789127455.279335:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789535232 00000100:00100000:1.0:1789127455.279382:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789127455.279391:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6526:x1876035789535232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789127455.279537:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6526:x1876035789535232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 147us (472us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789127455.279544:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789127455.279843:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1876035789535232:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789127455.279896:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1789127455.279932:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.279941:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.279948:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.279954:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587feda00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127455.279958:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.279982:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.280009:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4000) 00010000:00010000:0.0:1789127455.280012:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789127455.280016:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.280023:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785ddee lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789127455.280111:0:6526:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789127455.280158:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1789127455.280168:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 416472658012ns, next at 417472656190ns, rc = 0 00000001:00080000:0.0:1789127455.280195:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:0.0:1789127455.280217:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4000) 00010000:00010000:0.0:1789127455.280220:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789127455.280226:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddd9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd45 expref: 50 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127455.280499:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1baa450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+49:11644:x1876035771625856:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 16877us (17113us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1789127455.280544:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000020:00080000:0.0:1789127455.280550:0:6526:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789127455.287884:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.288198:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771626112 00000100:00100000:3.0:1789127455.288207:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771626112 00000100:00100000:3.0:1789127455.288270:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 111 00000100:00100000:3.0:1789127455.288279:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+49:11644:x1876035771626112:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127455.288313:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127455.288335:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785ddf5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd4c expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.288383:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785ddf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd4c expref: 50 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.288397:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785ddf5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd4c expref: 50 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.288414:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:3.0:1789127455.288417:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127455.288420:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a1000, rc 0) 00000100:00100000:3.0:1789127455.288478:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+50:11644:x1876035771626112:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 200us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127455.288486:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 111 00000100:00100000:2.0:1789127455.299926:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127455.300032:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771626368 00000100:00100000:1.0:1789127455.300044:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771626368 00000100:00100000:1.0:1789127455.300105:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:1.0:1789127455.300115:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690401e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+50:11644:x1876035771626368:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1789127455.300581:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690401e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+51:11644:x1876035771626368:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 466us (664us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1789127455.300590:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:1.0:1789127455.413047:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127455.413481:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771626496 00000100:00100000:0.0:1789127455.413491:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771626496 00000100:00100000:0.0:1789127455.413584:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:0.0:1789127455.413595:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+51:11654:x1876035771626496:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:0.0:1789127455.413685:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddfc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413703:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddfc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413716:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddfc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413727:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413735:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413741:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413813:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413822:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413829:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127455.413875:0:6522:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413890:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddfc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413905:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddfc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413912:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddfc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413918:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127455.413922:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddfc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413929:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddfc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413941:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:0.0:1789127455.413944:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127455.413949:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddfc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413955:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785ddfc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413968:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413974:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de03 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413980:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.413985:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587feda00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127455.414009:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.414015:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de03 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.414024:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff934587df4f00) 00010000:00010000:0.0:1789127455.414027:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127455.414030:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de03 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.414036:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.414046:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.414051:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de0a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.414056:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.414060:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fecc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127455.414063:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.414068:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de0a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.414075:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:0.0:1789127455.414076:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127455.414086:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de0a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.414091:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127455.414166:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e73c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+51:11654:x1876035771626496:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 573us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127455.414667:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:2.0:1789127455.478064:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.478396:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771626752 00000100:00100000:3.0:1789127455.478408:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771626752 00000100:00100000:3.0:1789127455.478477:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:3.0:1789127455.478487:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+51:11657:x1876035771626752:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127455.478534:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127455.478560:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785de11 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd53 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.478636:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785de18 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.478655:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785de18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.478683:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785de18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.478696:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785de1f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.478703:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785de1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.478709:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785de1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.478825:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785de26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.478837:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785de26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.478857:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785de26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127455.478870:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789127455.478945:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785de18 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.478952:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785de18 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.478958:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785de18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.478976:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127455.479322:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785de18 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.479335:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785de18 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.479346:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:3.0:1789127455.479349:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127455.479354:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785de18 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.479359:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785de18 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.479372:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785de1f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.479378:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785de1f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.479383:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785de1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.479389:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127455.479391:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785de1f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.479396:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785de1f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.479403:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff934587df4f00) 00010000:00010000:3.0:1789127455.479405:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127455.479414:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785de1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.479420:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785de1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.479457:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785de11 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd53 expref: 54 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.479469:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785de26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd53 expref: 53 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.479475:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:3.0:1789127455.479478:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127455.479480:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ffa00, rc 0) 00000100:00100000:3.0:1789127455.480913:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+53:11657:x1876035771626752:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 2418us (2848us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789127455.480924:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:2.0:1789127455.491996:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127455.496592:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771626880 00000100:00100000:0.0:1789127455.496606:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771626880 00000100:00100000:0.0:1789127455.496688:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:0.0:1789127455.496699:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690401680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+53:11657:x1876035771626880:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:0.0:1789127455.496765:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de34 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.496783:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.496795:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.496832:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de34 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.496839:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de34 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.496847:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.496853:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fecc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127455.496871:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de34 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.496879:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de34 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.496891:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:0.0:1789127455.496893:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127455.496898:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de34 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.496904:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de34 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127455.497116:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690401680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+53:11657:x1876035771626880:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 417us (5136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127455.497124:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:1.0:1789127455.506246:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127455.506464:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771627136 00000100:00100000:2.0:1789127455.506474:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771627136 00000100:00100000:2.0:1789127455.506564:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:2.0:1789127455.506574:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+53:11657:x1876035771627136:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1789127455.506795:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+54:11657:x1876035771627136:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 222us (559us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789127455.506803:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:2.0:1789127455.622779:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127455.622878:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771627392 00000100:00100000:0.0:1789127455.622887:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771627392 00000100:00100000:0.0:1789127455.622943:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:0.0:1789127455.622953:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690402d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+54:11667:x1876035771627392:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1789127455.622976:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127455.622979:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789127455.623012:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785ddb6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd37 expref: 54 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.623030:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:0.0:1789127455.623034:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127455.623047:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de3b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd5a expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.623163:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.623192:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.623204:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127455.623214:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789127455.623332:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de3b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd5a expref: 56 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.623346:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd5a expref: 55 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.623354:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:0.0:1789127455.623357:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127455.623360:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587feda00, rc 0) 00000100:00100000:0.0:1789127455.623420:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690402d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+55:11667:x1876035771627392:12345-192.168.206.48@tcp:101:bash.0 Request processed in 468us (649us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1789127455.623427:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:1.0:1789127455.631890:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127455.631996:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771627520 00000100:00100000:0.0:1789127455.632005:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771627520 00000100:00100000:0.0:1789127455.632062:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:0.0:1789127455.632071:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+55:11667:x1876035771627520:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1789127455.632094:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127455.632123:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de50 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd61 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.632156:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785de57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.632185:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785de57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.632197:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785de57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.632312:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de50 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd61 expref: 57 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.632329:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785de57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd61 expref: 56 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.632337:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:0.0:1789127455.632340:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127455.632343:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec400, rc 0) 00000100:00100000:0.0:1789127455.632701:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fbbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+56:11667:x1876035771627520:12345-192.168.206.48@tcp:101:bash.0 Request processed in 629us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127455.632709:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:2.0:1789127455.655296:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127455.655448:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771627648 00000100:00100000:0.0:1789127455.655457:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771627648 00000100:00100000:0.0:1789127455.655537:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:0.0:1789127455.655548:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9deac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+56:2399:x1876035771627648:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127455.655564:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127455.655599:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd5a expref: 56 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.655616:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:0.0:1789127455.655621:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127455.655680:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9deac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+55:2399:x1876035771627648:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 123us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127455.655689:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:1.0:1789127455.660153:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127455.660403:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771627904 00000100:00100000:0.0:1789127455.660412:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771627904 00000100:00100000:0.0:1789127455.660468:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:0.0:1789127455.660477:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+55:11667:x1876035771627904:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:0.0:1789127455.660546:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127455.660572:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785de26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd53 expref: 55 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.660591:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:0.0:1789127455.660596:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127455.660780:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de5e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.660795:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.660805:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789127455.660844:0:6524:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:0.0:1789127455.660865:0:6524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000008404102 reply state 00000000df7e4910 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de5e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.660889:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.660896:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:0.0:1789127455.660898:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127455.660901:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127455.661000:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fbb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+57:11667:x1876035771627904:12345-192.168.206.48@tcp:36:bash.0 Request processed in 523us (854us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789127455.661008:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 117 00000020:00080000:0.0:1789127455.661013:0:6524:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789127455.672405:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127455.678624:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127455.678817:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771628032 00000100:00100000:1.0:1789127455.678826:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771628032 00000100:00100000:1.0:1789127455.678885:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:1.0:1789127455.678895:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690400f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+57:11667:x1876035771628032:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1789127455.678919:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127455.678939:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785de65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd68 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.679062:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785de6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.679076:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785de6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.679086:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785de6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127455.679116:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789127455.679121:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127455.679139:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785de6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.679165:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785de65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd68 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.679201:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785de6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd68 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.679210:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:1.0:1789127455.679212:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127455.679215:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858ca00, rc 0) 00000100:00100000:1.0:1789127455.679296:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690400f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+58:11667:x1876035771628032:12345-192.168.206.48@tcp:101:bash.0 Request processed in 402us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127455.679303:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:2.0:1789127455.684284:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127455.684353:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771628288 00000100:00100000:1.0:1789127455.684363:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771628288 00000100:00100000:1.0:1789127455.684432:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:1.0:1789127455.684440:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+58:11667:x1876035771628288:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:1.0:1789127455.684659:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:11667:x1876035771628288:12345-192.168.206.48@tcp:35:bash.0 Request processed in 219us (381us total) trans 4294967397 rc 0/0 00000100:00100000:1.0:1789127455.684666:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:2.0:1789127455.821235:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127455.822757:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771628416 00000100:00100000:0.0:1789127455.822772:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771628416 00000100:00100000:0.0:1789127455.822850:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 119 00000100:00100000:0.0:1789127455.822860:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:11673:x1876035771628416:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127455.822883:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127455.822905:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd6f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.822980:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785de7a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.823008:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785de7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.823021:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785de7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127455.823067:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1789127455.823071:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127455.823104:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785de7a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.823129:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785de73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd6f expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.823147:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785de7a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd6f expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.823155:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:0.0:1789127455.823158:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127455.823162:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec800, rc 0) 00000100:00100000:0.0:1789127455.823236:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:11673:x1876035771628416:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 377us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127455.823243:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 119 00000100:00100000:2.0:1789127455.827449:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127455.827555:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771628544 00000100:00100000:1.0:1789127455.827564:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771628544 00000100:00100000:1.0:1789127455.827612:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:1.0:1789127455.827621:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690400780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:11673:x1876035771628544:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1789127455.827638:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127455.827658:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785de81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd76 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.827728:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785de88 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.827742:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785de88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.827752:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785de88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.827762:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785de8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.827768:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785de8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.827773:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785de8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.827860:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785de96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.827869:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785de96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.827877:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785de96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127455.827916:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789127455.827921:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127455.827939:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785de96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.827952:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785de96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.827961:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785de88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.827980:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785de88 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.827986:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785de88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.828002:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127455.828006:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785de88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.828014:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785de88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.828034:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:1.0:1789127455.828037:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127455.828041:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785de88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.828047:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785de88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.828059:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785de8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.828065:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785de8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.828070:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785de8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.828075:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858cc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127455.828077:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785de8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.828082:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785de8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.828089:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff934587df4f00) 00010000:00010000:1.0:1789127455.828092:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127455.828095:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785de8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.828100:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785de8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.828133:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785de81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd76 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.828146:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785de96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd76 expref: 61 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.828153:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:1.0:1789127455.828155:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127455.828158:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858da00, rc 0) 00000100:00100000:1.0:1789127455.828221:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690400780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11673:x1876035771628544:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 601us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127455.828229:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:2.0:1789127455.833868:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.833948:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771628800 00000100:00100000:3.0:1789127455.833957:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771628800 00000100:00100000:3.0:1789127455.834023:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:3.0:1789127455.834032:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690401a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11673:x1876035771628800:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127455.834050:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127455.834071:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785de9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd7d expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834190:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834221:0:9447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785de6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd68 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834228:0:9447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785de96 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd76 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834235:0:9447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834486:0:9447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785de96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd76 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834499:0:9447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785de96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd76 expref: 62 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127455.834536:0:9447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690406940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9447:1876035789535360:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127455.834705:0:9447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785de6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd68 expref: 62 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.834715:0:9447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785de6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd68 expref: 62 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127455.834724:0:9447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690407c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9447:1876035789535488:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127455.834750:0:9447:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127455.839437:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.839587:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771628928 00000100:00100000:3.0:1789127455.839596:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771628928 00010000:00010000:3.0:1789127455.839643:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785de96 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd76 expref: 63 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127455.839689:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 82 00000100:00100000:3.0:1789127455.839709:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e52580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+63:2401:x1876035771628928:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127455.839723:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127455.839731:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785de96 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd76 expref: 63 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.839743:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785de96 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd76 expref: 63 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.839762:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:3.0:1789127455.839768:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.839776:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.839782:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127455.839845:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e52580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+63:2401:x1876035771628928:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 148us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127455.839852:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 82 00010000:00010000:3.0:1789127455.840314:0:9447:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.48@tcp) returned -22 from blocking AST (req@00000000d86502d5 x1876035789535360) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785de96 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd76 expref: 62 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.840329:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785de96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd76 expref: 62 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127455.840359:0:9447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690406940 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9447:1876035789535360:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127455.840375:0:9447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690407c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9447:1876035789535488:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127455.840394:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:3.0:1789127455.840398:0:9447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.840405:0:9447:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.840414:0:9447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127455.844953:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127455.845101:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771629056 00000100:00100000:0.0:1789127455.845111:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771629056 00010000:00010000:0.0:1789127455.845151:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785de6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd68 expref: 62 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127455.845198:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 83 00000100:00100000:0.0:1789127455.845208:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+62:2402:x1876035771629056:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127455.845223:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127455.845229:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785de6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd68 expref: 62 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.845252:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785de6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd68 expref: 62 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.845293:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785de6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd68 expref: 62 pid: 6523 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.845306:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:0.0:1789127455.845311:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.845320:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.845327:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.845364:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127455.845415:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e530c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:2402:x1876035771629056:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 208us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127455.845422:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 83 00010000:00010000:1.0:1789127455.845612:0:9447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.845621:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127455.845638:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789127455.845757:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785de9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd7d expref: 62 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.845773:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd7d expref: 61 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.845780:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:1.0:1789127455.845783:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789127455.845792:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff000, rc 0) 00000100:00100000:1.0:1789127455.845817:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690401a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11673:x1876035771628800:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 11787us (11959us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789127455.845825:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:0.0:1789127455.857196:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127455.857294:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771629312 00000100:00100000:3.0:1789127455.857303:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771629312 00000100:00100000:3.0:1789127455.857370:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:3.0:1789127455.857381:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11673:x1876035771629312:12345-192.168.206.48@tcp:103:lfs.0 00010000:00010000:3.0:1789127455.857395:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127455.857418:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785ddf5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd4c expref: 61 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127455.857436:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:3.0:1789127455.857440:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127455.857497:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:11673:x1876035771629312:12345-192.168.206.48@tcp:103:lfs.0 Request processed in 118us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127455.857505:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1789127455.863916:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127455.864040:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771629440 00000100:00100000:1.0:1789127455.864051:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771629440 00000100:00100000:1.0:1789127455.864107:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:1.0:1789127455.864117:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:11673:x1876035771629440:12345-192.168.206.48@tcp:58:lfs.0 00010000:00010000:1.0:1789127455.864233:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785deb2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.864262:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785deb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127455.864274:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785deb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127455.864365:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789127455.864449:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e51a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:11673:x1876035771629440:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 332us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127455.864457:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:2.0:1789127455.867277:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127455.867586:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771629568 00000100:00100000:0.0:1789127455.867608:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771629568 00000100:00100000:0.0:1789127455.867663:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 123 00000100:00100000:0.0:1789127455.867672:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:11673:x1876035771629568:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127455.867690:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127455.867711:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785deb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd84 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.867771:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785deb2 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.867795:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785deb9 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd84 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.867814:0:6524:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785deb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.867826:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785deb9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd84 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.867838:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:0.0:1789127455.867841:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127455.867844:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785deb9 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd84 expref: 61 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127455.867852:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587feda00, rc 0) 00000100:00100000:0.0:1789127455.867906:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e521c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11673:x1876035771629568:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 235us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127455.867913:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 123 00000100:00100000:2.0:1789127456.253820:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127456.253881:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127456.253913:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127456.253944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127456.253980:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127456.253997:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127456.254022:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127456.254048:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771629952 00000100:00100000:2.0:1789127456.254058:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771629952 00000100:00100000:2.0:1789127456.254110:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771630464 00000100:00100000:2.0:1789127456.254114:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771630464 00000100:00100000:0.0:1789127456.254125:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771630208 00000100:00100000:2.0:1789127456.254130:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771629824 00000100:00100000:0.0:1789127456.254134:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771630208 00000100:00100000:2.0:1789127456.254135:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771629824 00000100:00100000:2.0:1789127456.254150:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771630336 00000100:00100000:2.0:1789127456.254152:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771630336 00000100:00100000:2.0:1789127456.254182:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 317 00000100:00100000:2.0:1789127456.254192:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771629952:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127456.254268:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e512c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771629952:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 77us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127456.254276:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 317 00000100:00100000:0.0:1789127456.254411:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771630080 00000100:00100000:0.0:1789127456.254415:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771630080 00000100:00100000:0.0:1789127456.254443:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:0.0:1789127456.254451:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771630208:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127456.254482:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771630208:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 33us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.254489:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:0.0:1789127456.254541:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:0.0:1789127456.254548:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e51e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2399:x1876035771630080:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127456.254578:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e51e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2399:x1876035771630080:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 31us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.254585:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:0.0:1789127456.254606:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 318 00000100:00100000:0.0:1789127456.254612:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771630464:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127456.254650:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771629696 00000100:00100000:0.0:1789127456.254652:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e53c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771630464:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 38us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.254661:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 318 00000100:00100000:3.0:1789127456.254663:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771629696 00000100:00100000:0.0:1789127456.254678:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 319 00000100:00100000:0.0:1789127456.254687:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:2399:x1876035771629824:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127456.254709:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e53840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:2399:x1876035771629824:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 26us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.254715:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 319 00000100:00100000:0.0:1789127456.254730:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 320 00000100:00080000:1.0:1789127456.254735:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127456.254736:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771630336:12345-192.168.206.48@tcp:400:kworker.0 00000100:00080000:1.0:1789127456.254742:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127456.254747:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127456.254764:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e503c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771630336:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 29us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.254770:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 320 00000100:00100000:3.0:1789127456.260229:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 446 00000100:00100000:3.0:1789127456.261141:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934688ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771629696:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127456.261240:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934688ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771629696:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 998us (7433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127456.262420:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 446 00010000:00010000:3.0:1789127456.695790:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789127456.762684:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789127456.762697:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127456.762739:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1789127456.762751:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789127456.762997:0:14502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690407c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14502:1876035789535616:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789127456.763282:0:14502:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5480 going to sleep for 11 seconds 00000100:00100000:3.0:1789127456.783599:0:14502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690407c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14502:1876035789535616:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789127456.790355:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.791698:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771630592 00000100:00100000:0.0:1789127456.791715:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771630592 00000100:00100000:0.0:1789127456.791813:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 124 00000100:00100000:0.0:1789127456.791827:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11674:x1876035771630592:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789127456.791889:0:6523:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789127456.792078:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e51680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11674:x1876035771630592:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 253us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.792086:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 124 00000100:00100000:2.0:1789127456.818462:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.818629:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771630720 00000100:00100000:0.0:1789127456.818644:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771630720 00000100:00100000:0.0:1789127456.818725:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:0.0:1789127456.818737:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11674:x1876035771630720:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789127456.818835:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785dec0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.818868:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785dec0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.818884:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785dec0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.818905:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dec7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.818912:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dec7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.818919:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dec7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.818948:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dece lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.818958:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.818982:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127456.819056:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789127456.819061:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127456.819079:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819092:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785dec0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819098:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785dec0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819105:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785dec0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819111:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127456.819115:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785dec0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819124:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785dec0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819137:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4200) 00010000:00010000:0.0:1789127456.819140:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127456.819145:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785dec0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819152:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785dec0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819191:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dec7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819197:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dec7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819202:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dec7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819207:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fede00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127456.819210:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dec7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819216:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dec7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819223:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9346a69cbe00) 00010000:00010000:0.0:1789127456.819225:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127456.819228:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dec7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819233:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dec7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819247:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dece lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819252:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dece lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819257:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819267:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fedc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127456.819270:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dece lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819276:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dece lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819283:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:0.0:1789127456.819286:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127456.819288:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dece lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.819293:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785dece lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127456.819391:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e52d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11674:x1876035771630720:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 656us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.819401:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:3.0:1789127456.826310:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.826405:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771630976 00000100:00100000:0.0:1789127456.826432:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771630976 00000100:00100000:0.0:1789127456.826562:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:0.0:1789127456.826576:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690407c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+61:11674:x1876035771630976:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127456.826604:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127456.826796:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785ded5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd8b expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.826938:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dedc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.826979:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dedc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.826993:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dedc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127456.827006:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789127456.827229:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dedc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.827238:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dedc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.827246:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dedc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.827253:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fede00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127456.827257:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dedc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.827265:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dedc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.827286:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:0.0:1789127456.827290:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789127456.827296:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dedc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.827303:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dedc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.827952:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785ded5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd8b expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.827983:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4200) 00010000:00010000:0.0:1789127456.827986:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127456.827992:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785ded5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd8b expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.828002:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fedc00, rc 0) 00000100:00100000:0.0:1789127456.829545:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690407c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+62:11674:x1876035771630976:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 2932us (3205us total) trans 4294967399 rc 301/301 00000100:00100000:0.0:1789127456.829560:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:3.0:1789127456.834609:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.834782:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771631104 00000100:00100000:0.0:1789127456.834799:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771631104 00000100:00100000:0.0:1789127456.834887:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 127 00000100:00100000:0.0:1789127456.834901:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690406940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+62:11674:x1876035771631104:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789127456.834947:0:6524:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789127456.835096:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690406940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+62:11674:x1876035771631104:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 199us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.835104:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 127 00000100:00100000:2.0:1789127456.840026:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127456.840138:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771631360 00000100:00100000:1.0:1789127456.840148:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771631360 00000100:00100000:1.0:1789127456.840221:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:1.0:1789127456.840231:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+62:11674:x1876035771631360:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127456.840254:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127456.840272:0:9447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789127456.840302:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785de7a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd6f expref: 62 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.840320:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:1.0:1789127456.840326:0:9447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127456.840339:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785deea lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd92 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789127456.840754:0:9447:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:1.0:1789127456.840888:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785def1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.840902:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785def1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.840912:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785def1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.840958:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785deea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd92 expref: 64 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.840972:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785def1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd92 expref: 63 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.840980:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93468b042700) 00010000:00010000:1.0:1789127456.840983:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127456.840985:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c200, rc 0) 00000100:00100000:1.0:1789127456.841053:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e50f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+63:11674:x1876035771631360:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 822us (1034us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1789127456.841072:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:3.0:1789127456.848922:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.849055:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771631616 00000100:00100000:0.0:1789127456.849072:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771631616 00000100:00100000:0.0:1789127456.849152:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 129 00000100:00100000:0.0:1789127456.849163:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690407840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+63:11674:x1876035771631616:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789127456.849266:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127456.849302:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785def1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd92 expref: 63 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.849357:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff93468b042700) 00010000:00010000:0.0:1789127456.849370:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127456.849399:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785deff lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.849414:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785deff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.849435:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785deff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.849453:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df06 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x1b02834d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.849461:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1b02834d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.849467:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1b02834d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.849562:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785deff lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.849570:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785deff lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.849577:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785deff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.849583:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fedc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127456.849588:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785deff lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.849603:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785deff lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.850142:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:0.0:1789127456.850146:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127456.850152:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785deff lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.850158:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785deff lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.850182:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df06 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x1b02834d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.850188:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df06 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1b02834d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.850195:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df06 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1b02834d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.850200:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fede00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127456.850203:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df06 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1b02834d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.850209:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df06 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x1b02834d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.850216:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x1b02834d (ffff9346a69cbe00) 00010000:00010000:0.0:1789127456.850219:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127456.850222:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df06 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1b02834d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.850240:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df06 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x1b02834d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127456.850375:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690407840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+62:11674:x1876035771631616:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 1209us (1458us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127456.850386:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 129 00000100:00100000:2.0:1789127456.852805:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.852905:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771631744 00000100:00100000:0.0:1789127456.852916:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771631744 00000100:00100000:0.0:1789127456.852970:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 130 00000100:00100000:0.0:1789127456.852980:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+62:11674:x1876035771631744:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127456.852998:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127456.853020:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785df0d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffd99 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.853055:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.853069:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.853081:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.853204:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785df0d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd99 expref: 64 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.853221:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd99 expref: 63 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.853242:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:0.0:1789127456.853246:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127456.853249:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec600, rc 0) 00000100:00100000:0.0:1789127456.853308:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+63:11674:x1876035771631744:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 329us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.853316:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 130 00000100:00100000:2.0:1789127456.859932:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.860050:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771632000 00000100:00100000:0.0:1789127456.860064:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771632000 00000100:00100000:0.0:1789127456.860130:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:0.0:1789127456.860143:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+63:11674:x1876035771632000:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789127456.860236:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785df1b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.860253:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785df1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.860265:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785df1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127456.860477:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1789127456.860488:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 418052977550ns, next at 419052975028ns, rc = 0 00000004:00010000:0.0:1789127456.860621:0:6522:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002555af7d reply state 00000000c469d012 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785df1b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.860635:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785df1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.860642:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:0.0:1789127456.860657:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789127456.860661:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127456.860762:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e50780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+65:11674:x1876035771632000:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 622us (844us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789127456.860770:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:3.0:1789127456.865892:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.865978:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771632128 00000100:00100000:0.0:1789127456.865987:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771632128 00000100:00100000:0.0:1789127456.866057:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:0.0:1789127456.866068:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690405e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+65:11674:x1876035771632128:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127456.866091:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127456.866110:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffda0 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.866179:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffda0 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.866195:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffda0 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.866212:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:0.0:1789127456.866215:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127456.866219:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fede00, rc 0) 00000100:00100000:0.0:1789127456.866273:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690405e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+66:11674:x1876035771632128:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 207us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.866280:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:2.0:1789127456.870863:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127456.870980:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771632256 00000100:00100000:3.0:1789127456.870993:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771632256 00000100:00100000:3.0:1789127456.871134:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:3.0:1789127456.871147:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2401:x1876035771632256:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789127456.871774:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2401:x1876035771632256:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 626us (922us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789127456.871783:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:2.0:1789127456.893466:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127456.896802:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771632512 00000100:00100000:1.0:1789127456.896825:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771632512 00000100:00100000:1.0:1789127456.896926:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:1.0:1789127456.896938:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+66:11674:x1876035771632512:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789127456.897450:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+67:11674:x1876035771632512:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 512us (3995us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1789127456.897460:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:2.0:1789127456.914304:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.914410:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771632768 00000100:00100000:0.0:1789127456.914419:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771632768 00000100:00100000:0.0:1789127456.914486:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 133 00000100:00100000:0.0:1789127456.914503:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+67:11674:x1876035771632768:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789127456.914651:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+67:11674:x1876035771632768:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 150us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.914659:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 133 00000100:00100000:2.0:1789127456.919592:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.919682:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771632896 00000100:00100000:0.0:1789127456.919692:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771632896 00000100:00100000:0.0:1789127456.919747:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 134 00000100:00100000:0.0:1789127456.919755:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+67:11674:x1876035771632896:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127456.919773:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127456.919794:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785df29 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffda7 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.919876:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.919889:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.919900:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127456.919941:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127456.919958:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.919982:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785df29 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffda7 expref: 69 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.919998:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffda7 expref: 68 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.920019:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:0.0:1789127456.920022:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789127456.920025:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec800, rc 0) 00000100:00100000:0.0:1789127456.920071:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+68:11674:x1876035771632896:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 316us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.920078:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 134 00000100:00100000:2.0:1789127456.927563:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.927626:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771633024 00000100:00100000:0.0:1789127456.927640:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771633024 00000100:00100000:0.0:1789127456.927701:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:0.0:1789127456.927711:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2401:x1876035771633024:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127456.927728:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127456.927748:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f2ac4c7/0xd718aadfd785df37 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffdae expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789127456.927773:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3eb1f, blocks: 0x0 00010000:00010000:0.0:1789127456.927792:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=418s v=(0 0) 00010000:00010000:0.0:1789127456.927797:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127456.927807:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f2ac4c7/0xd718aadfd785df37 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdae expref: 10 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.927825:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f2ac4c7/0xd718aadfd785df37 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdae expref: 10 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.927838:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fedc00, rc 0) 00000100:00100000:0.0:1789127456.928036:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+10:2401:x1876035771633024:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 326us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.928044:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:2.0:1789127456.930641:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.930785:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771633280 00000100:00100000:0.0:1789127456.930794:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771633280 00000100:00100000:0.0:1789127456.930856:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 135 00000100:00100000:0.0:1789127456.930867:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+68:11674:x1876035771633280:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789127456.930966:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+68:11674:x1876035771633280:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 101us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.930974:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 135 00000100:00100000:2.0:1789127456.934669:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127456.934780:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771633408 00000100:00100000:1.0:1789127456.934798:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771633408 00000100:00100000:1.0:1789127456.934884:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:1.0:1789127456.934896:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+10:11674:x1876035771633408:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127456.934918:0:10363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127456.934941:0:10363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785df3e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffdb5 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.935006:0:10363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f2ac4c7/0xd718aadfd785df37 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdae expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.935017:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127456.935022:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127456.935028:0:10363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785df3e lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdb5 expref: 11 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.935085:0:10363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f2ac4c7/0xd718aadfd785df37 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdae expref: 11 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.935110:0:10363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f2ac4c7/0xd718aadfd785df37 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdae expref: 11 pid: 8440 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127456.935126:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10363:1876035789535744:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789127456.935263:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127456.938914:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127456.939352:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb9e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10363:1876035789535744:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127456.939398:0:10363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785df3e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdb5 expref: 11 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.939420:0:10363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858cc00, rc 0) 00000100:00100000:0.0:1789127456.939566:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771633536 00000100:00100000:0.0:1789127456.939582:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771633536 00010000:00010000:0.0:1789127456.939651:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f2ac4c7/0xd718aadfd785df37 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdae expref: 12 pid: 8440 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127456.939693:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:0.0:1789127456.939716:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+12:2401:x1876035771633536:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127456.939735:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127456.939761:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f2ac4c7/0xd718aadfd785df37 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdae expref: 12 pid: 8440 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.939777:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f2ac4c7/0xd718aadfd785df37 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdae expref: 12 pid: 8440 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.939806:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f2ac4c7/0xd718aadfd785df37 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdae expref: 12 pid: 8440 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127456.939839:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+12:11674:x1876035771633408:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 4939us (5170us total) trans 0 rc 0/0 00010000:00010000:0.0:1789127456.939859:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00000100:00100000:1.0:1789127456.939866:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00010000:00010000:0.0:1789127456.939871:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127456.939897:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785df3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdb5 expref: 10 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.939911:0:9539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785df3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdb5 expref: 10 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.939957:0:9539:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785df3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdb5 expref: 10 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127456.939974:0:9539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9539:1876035789535872:192.168.206.48@tcp:105: 00000100:00100000:0.0:1789127456.940492:0:9539:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127456.946983:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.947078:0:9539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9539:1876035789535872:192.168.206.48@tcp:105: 00010000:00010000:0.0:1789127456.947099:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127456.947153:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+10:2401:x1876035771633536:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 7451us (8247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.947178:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 84 00000100:00100000:1.0:1789127456.948053:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771633664 00000100:00100000:1.0:1789127456.948064:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771633664 00002000:00100000:1.0:1789127456.948108:0:8445:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9345887e0f00 x1876035771633664/t0(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:192/0 lens 504/0 e 0 to 0 dl 1789127467 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127456.948119:0:8445:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9345887e0f00 with x1876035771633664 ext(0->12) 00002000:00010000:1.0:1789127456.948125:0:8445:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9345887e0f00 00000100:00100000:1.0:1789127456.948154:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:1.0:1789127456.948164:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+10:2401:x1876035771633664:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789127456.949761:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+12:2401:x1876035771633664:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 Request processed in 1592us (2780us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789127456.949780:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00002000:00100000:1.0:1789127456.949791:0:8445:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9345887e0f00 x1876035771633664/t4294967309(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:192/0 lens 504/448 e 0 to 0 dl 1789127467 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127456.949802:0:8445:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9345887e0f00 with x1876035771633664 ext(0->12) 00002000:00010000:1.0:1789127456.949808:0:8445:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9345887e0f00 00000100:00100000:2.0:1789127456.953477:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127456.953712:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771633792 00000100:00100000:1.0:1789127456.953721:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771633792 00000100:00100000:1.0:1789127456.953779:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 136 00000100:00100000:1.0:1789127456.953789:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+68:11674:x1876035771633792:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789127456.956894:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1789127456.956910:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1789127456.956944:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789127456.956970:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff934687b13180 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1789127456.956974:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff934687b27f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff934687b13e40 00000020:00080000:2.0:1789127456.956977:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff934687b27100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff934587e27400 00000004:00080000:2.0:1789127456.957016:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789127456.957042:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff934685297b40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1789127456.957045:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93469134f300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff934685297e40 00000020:00080000:2.0:1789127456.957048:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff93469134fd00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9346bebc7200 00000020:00080000:2.0:1789127456.957057:0:6501:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00010000:00010000:3.0:1789127456.957131:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dc43 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957158:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dc43 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127456.957248:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789536000:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1789127456.957286:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dc43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957294:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127456.957299:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dc43 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957308:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dc43 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957326:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9346c20f8300) 00000100:00100000:2.0:1789127456.957328:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127456.957332:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127456.957338:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dc43 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957344:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785dc43 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957372:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dceb lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957378:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dceb lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957384:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dceb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957389:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127456.957399:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dceb lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957406:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dceb lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957415:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff934587df4e00) 00010000:00010000:3.0:1789127456.957418:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127456.957421:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dceb lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957428:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dceb lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957443:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd69 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957449:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd69 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957457:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957463:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127456.957466:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd69 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957472:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd69 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957480:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff934587df4f00) 00010000:00010000:3.0:1789127456.957482:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127456.957490:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd69 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957498:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dd69 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127456.957535:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789536256:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789127456.957543:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd8c lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957552:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd8c lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957559:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957565:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1c00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127456.957569:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd8c lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957576:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd8c lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957584:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff934587df4f00) 00010000:00010000:3.0:1789127456.957587:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127456.957590:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd8c lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957595:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785dd8c lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957609:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de5e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957805:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de5e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957811:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957816:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fecc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127456.957819:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de5e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957825:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de5e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957833:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:3.0:1789127456.957835:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127456.957838:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de5e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957843:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785de5e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957855:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785df1b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957862:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785df1b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957867:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785df1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957872:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127456.957880:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785df1b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957887:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785df1b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957895:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:3.0:1789127456.957897:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789127456.957899:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785df1b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.957905:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785df1b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1789127456.957921:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789127456.957976:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789127456.957991:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789536128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789127456.958022:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127456.958130:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:11674:x1876035771633792:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 4339us (4658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127456.958140:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 136 00000100:00100000:1.0:1789127456.959182:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127456.960380:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789536000 00000100:00100000:3.0:1789127456.960390:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789536000 00000100:00100000:3.0:1789127456.960448:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789536128 00000100:00100000:3.0:1789127456.960452:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789536128 00000100:00100000:3.0:1789127456.960476:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789536256 00000100:00100000:3.0:1789127456.960479:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789536256 00000100:00100000:3.0:1789127456.960496:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789127456.960505:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789536000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789127456.960555:0:8440:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1789127456.960586:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3eb1e, atime: 0x6aa3eb1e, ctime: 0x6aa3eb1e, blocks: 0x8 00010000:00010000:3.0:1789127456.960594:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785df45 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789127456.961440:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127456.961466:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789127456.961479:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3650:x1876035789536128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789127456.961498:0:8438:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:1.0:1789127456.961539:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.961558:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f7d9aa78/0xd718aadfd785dcf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd0d expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.961581:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1789127456.961585:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789127456.961590:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df4c lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.961950:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1789127456.961953:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127456.961960:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785df45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.961975:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785df45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.961986:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785df45 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.961994:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785df45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127456.962022:0:8440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127456.962374:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f7d9aa78/0xd718aadfd785dcf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd0d expref: 11 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.962392:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f7d9aa78/0xd718aadfd785dcf9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd0d expref: 11 pid: 8439 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127456.962407:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb9680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1876035789536384:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789127456.962477:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341600 going to sleep for 11 seconds 00000100:00100000:1.0:1789127456.962503:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789127456.962536:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346bf8bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3651:x1876035789536256:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789127456.962628:0:10363:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789127456.962632:0:10363:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789127456 00002000:00010000:1.0:1789127456.962634:0:10363:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789127456.962637:0:10363:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789127455 -> 1789127456 00002000:00010000:1.0:1789127456.962639:0:10363:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789127456.962677:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346bf8bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3651:x1876035789536256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 165us (3510us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789127456.962685:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789127456.963971:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3653:x1876035789536000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3460us (6651us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789127456.963984:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000004:00080000:1.0:1789127456.964798:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9346b7fb83c0/2, rc 0, transno 4294967310 00000100:00100000:1.0:1789127456.964821:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789536256:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1789127456.965970:0:3653:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff934587ff8f00/2, rc 0, transno 4294967305 00000100:00100000:3.0:1789127456.965981:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789536000:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789127456.966332:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.966997:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771633920 00000100:00100000:0.0:1789127456.967007:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771633920 00010000:00010000:0.0:1789127456.967023:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127456.967032:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785df45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.967044:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127456.967061:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785df45 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.967071:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785df45 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.967092:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785df45 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.967100:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785df45 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.967123:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127456.967125:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127456.967126:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127456.967193:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:0.0:1789127456.967208:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+12:2399:x1876035771633920:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789127456.972991:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb9680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1876035789536384:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127456.973018:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df4c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127456.979416:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1789127456.979429:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1789127456.979637:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2399:x1876035771633920:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 12429us (13302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.979649:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:1.0:1789127456.984902:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.985424:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771634048 00000100:00100000:0.0:1789127456.985434:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771634048 00010000:00010000:0.0:1789127456.985472:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f7d9aa78/0xd718aadfd785dcf9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd0d expref: 7 pid: 8439 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127456.985503:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 85 00000100:00100000:0.0:1789127456.985537:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fbad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771634048:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127456.985566:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127456.985573:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f7d9aa78/0xd718aadfd785dcf9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd0d expref: 7 pid: 8439 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.985588:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f7d9aa78/0xd718aadfd785dcf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd0d expref: 7 pid: 8439 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.985611:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7d9aa78/0xd718aadfd785dcf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd0d expref: 7 pid: 8439 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.985627:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127456.985632:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127456.985638:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.985648:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df4c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.985678:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127456.985749:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fbad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771634048:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 237us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127456.985757:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 85 00010000:00010000:2.0:1789127456.985892:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127456.985915:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127456.985925:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df4c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127456.985933:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127456.985956:0:8438:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789127456.986130:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789536128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24655us (28105us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789127456.986139:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1789127456.986221:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127456.986229:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.986238:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c200 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127456.986242:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df4c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.986252:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df4c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.986265:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df4c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.986273:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df4c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127456.986290:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127456.986292:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127456.986294:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127456.987381:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789127456.987401:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1789127456.987419:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9346b7fb83c0, transno 4294967310 00000100:00100000:0.0:1789127456.987433:0:3650:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9346b7fb9e00 x1876035789536128/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789127472 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789127456.987454:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9346b7fb9e00/2, rc 0, transno 4294967311 00000100:00100000:0.0:1789127456.987460:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789536128:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789127456.991056:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127456.991145:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771634304 00000100:00100000:0.0:1789127456.991154:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771634304 00000100:00100000:0.0:1789127456.991474:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 137 00000100:00100000:0.0:1789127456.991486:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:11674:x1876035771634304:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789127456.991635:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127456.991661:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffda7 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.991680:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:0.0:1789127456.991685:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127456.991712:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785df53 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.991803:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785df53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.991815:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785df53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127456.991928:0:6524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bf74aa66 reply state 000000004e5576b2 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785df53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.991940:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785df53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127456.991947:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:0.0:1789127456.991963:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127456.991966:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127456.992100:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+17:11674:x1876035771634304:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 615us (1051us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1789127456.992107:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 137 00000100:00100000:1.0:1789127457.000003:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127457.000084:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771634432 00000100:00100000:3.0:1789127457.000094:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771634432 00000100:00100000:3.0:1789127457.000155:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:3.0:1789127457.000181:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771634432:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789127457.000645:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789127457.000649:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789127456 -> 1789127454 00002000:00010000:3.0:1789127457.000652:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789127454 00002000:00010000:3.0:1789127457.000655:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789127456 -> 1789127454 00002000:00010000:3.0:1789127457.000657:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789127457.002887:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fb83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771634432:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 2712us (2883us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789127457.002903:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:1.0:1789127457.010899:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127457.011004:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771634688 00000100:00100000:0.0:1789127457.011012:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771634688 00000100:00100000:0.0:1789127457.011068:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 138 00000100:00100000:0.0:1789127457.011077:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+17:11674:x1876035771634688:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789127457.011139:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.011153:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd99 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.011163:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.011218:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd99 expref: 17 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.011231:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd99 expref: 17 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127457.011255:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff9680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789536512:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127457.011358:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297480 going to sleep for 11 seconds 00000100:00100000:2.0:1789127457.017092:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127457.017396:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771634816 00000100:00100000:3.0:1789127457.017405:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771634816 00010000:00010000:3.0:1789127457.017456:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df14 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd99 expref: 18 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127457.017504:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 86 00000100:00100000:3.0:1789127457.017551:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:2401:x1876035771634816:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127457.017567:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127457.017585:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df14 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd99 expref: 18 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127457.017599:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd99 expref: 18 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127457.017619:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:3.0:1789127457.017625:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127457.017634:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127457.017656:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127457.017677:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127457.017688:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd99 expref: 18 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127457.017722:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff9680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789536512:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127457.017726:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+17:2401:x1876035771634816:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 175us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127457.017734:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 86 00010000:00010000:0.0:1789127457.017820:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.017828:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.017833:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.017924:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.017932:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.017937:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.017942:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127457.017946:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.017953:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.017962:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:0.0:1789127457.017965:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789127457.017968:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.017981:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df5a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127457.018022:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:11674:x1876035771634688:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 Request processed in 6945us (7131us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789127457.018031:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 138 00000100:00100000:2.0:1789127457.021892:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127457.021947:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771634944 00000100:00100000:1.0:1789127457.021968:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771634944 00000100:00100000:1.0:1789127457.022035:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:1.0:1789127457.022044:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2399:x1876035771634944:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789127457.022102:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df61 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.022122:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785df3e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdb5 expref: 7 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.022131:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127457.022135:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789127457.022139:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df61 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.022182:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785df3e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdb5 expref: 7 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.022196:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785df3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdb5 expref: 7 pid: 10363 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127457.022210:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fbb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1876035789536640:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789127457.022294:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127457.028408:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127457.028503:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771635072 00000100:00100000:0.0:1789127457.028540:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771635072 00010000:00010000:0.0:1789127457.028579:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785df3e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdb5 expref: 8 pid: 10363 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127457.028622:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 87 00000100:00100000:0.0:1789127457.028631:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9de8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2402:x1876035771635072:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127457.028644:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127457.028663:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785df3e lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdb5 expref: 8 pid: 10363 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.028676:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785df3e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdb5 expref: 8 pid: 10363 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.028699:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127457.028704:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127457.028709:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df61 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.028719:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df61 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.028763:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127457.028812:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9de8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2402:x1876035771635072:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 180us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127457.028819:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 87 00010000:00010000:1.0:1789127457.034972:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785df3e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdb5 expref: 7 pid: 10363 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127457.034997:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fbb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1876035789536640:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127457.035022:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df61 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.040120:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df61 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.040299:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df61 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.040332:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df61 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.040361:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df61 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.040370:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.040377:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c200 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127457.040382:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df61 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.040391:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df61 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.040411:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df61 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.040419:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785df61 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127457.040619:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2399:x1876035771634944:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 18572us (18741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127457.040629:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:2.0:1789127457.045887:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127457.045967:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771635328 00000100:00100000:0.0:1789127457.045976:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771635328 00000100:00100000:0.0:1789127457.046034:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 139 00000100:00100000:0.0:1789127457.046046:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:11674:x1876035771635328:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789127457.046119:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.046147:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785de57 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd61 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.046157:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.046197:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785de57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd61 expref: 16 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.046210:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785de57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd61 expref: 16 pid: 6522 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127457.046223:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789536768:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127457.046377:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127457.054216:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789536768:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127457.054265:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127457.057500:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127457.057668:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771635456 00000100:00100000:1.0:1789127457.057677:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771635456 00010000:00010000:1.0:1789127457.057716:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785de57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd61 expref: 17 pid: 6522 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127457.057756:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 88 00000100:00100000:1.0:1789127457.057766:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+17:2401:x1876035771635456:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127457.057780:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127457.057786:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785de57 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd61 expref: 17 pid: 6522 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.057798:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785de57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd61 expref: 17 pid: 6522 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.057819:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785de57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd61 expref: 17 pid: 6522 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.057834:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:1.0:1789127457.057839:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785deb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd84 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.057848:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.057856:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.057880:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.057914:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127457.058013:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:2401:x1876035771635456:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 247us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127457.058021:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 88 00010000:00010000:0.0:1789127457.058082:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.058091:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.058260:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.058272:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffda0 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.058279:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.058305:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffda0 expref: 16 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.058318:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffda0 expref: 16 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127457.058331:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789536896:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127457.058380:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127457.072664:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789536896:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127457.072692:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127457.083919:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127457.088342:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771635584 00000100:00100000:0.0:1789127457.088358:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771635584 00010000:00010000:0.0:1789127457.088411:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffda0 expref: 17 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127457.088459:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 89 00000100:00100000:0.0:1789127457.088469:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+17:2402:x1876035771635584:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127457.088484:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127457.088491:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffda0 expref: 17 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.088505:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffda0 expref: 17 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.088565:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffda0 expref: 17 pid: 6523 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.088581:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:0.0:1789127457.088586:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.088595:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.088602:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.088635:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127457.088699:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:2402:x1876035771635584:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 231us (4788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127457.088708:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 89 00010000:00010000:2.0:1789127457.089292:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.089300:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789127457.089413:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1789127457.089570:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:2.0:1789127457.089607:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1789127457.089680:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345887e2940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1876035789537024:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789127457.089732:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127457.089767:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127457.090469:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789537024 00000100:00100000:3.0:1789127457.090477:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789537024 00000100:00100000:3.0:1789127457.090540:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789127457.090549:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6522:x1876035789537024:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789127457.090639:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6522:x1876035789537024:12345-0@lo:1000:mdt00_000.0 Request processed in 91us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127457.090646:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789127457.091918:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345887e2940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1876035789537024:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789127457.092064:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1789127457.092143:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345887e2940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1876035789537152:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789127457.092201:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127457.092235:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127457.092450:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789537152 00000100:00100000:0.0:1789127457.092458:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789537152 00000100:00100000:0.0:1789127457.092505:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789127457.092541:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6522:x1876035789537152:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789127457.092666:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6522:x1876035789537152:12345-0@lo:1000:mdt00_000.0 Request processed in 127us (464us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789127457.092673:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789127457.092786:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345887e2940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6522:1876035789537152:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789127457.092819:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.092828:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.092835:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.092840:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127457.092844:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.092867:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.092882:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:2.0:1789127457.092885:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789127457.092890:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.092896:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785df6f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.092918:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785deb2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.092924:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785deb2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.092930:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785deb2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.092935:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127457.092938:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785deb2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.092944:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785deb2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.092951:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:2.0:1789127457.092953:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789127457.092960:0:6522:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785deb9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd84 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.092983:0:6522:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785deb9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd84 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.092992:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785deb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd84 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.093017:0:6522:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785deb9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd84 expref: 19 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127457.093042:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345887e1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789537280:192.168.206.48@tcp:105: 00000100:00100000:2.0:1789127457.093821:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127457.098438:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127457.098541:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771635712 00000100:00100000:1.0:1789127457.098551:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771635712 00000100:00100000:1.0:1789127457.098600:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:1.0:1789127457.098611:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:11673:x1876035771635712:12345-192.168.206.48@tcp:49:lfs.0 00000100:00100000:1.0:1789127457.098734:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:11673:x1876035771635712:12345-192.168.206.48@tcp:49:lfs.0 Request processed in 125us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127457.098741:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:0.0:1789127457.098827:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345887e1e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789537280:192.168.206.48@tcp:105: 00010000:00010000:0.0:1789127457.098851:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785deb2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.098862:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785deb2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.098892:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df76 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.098905:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.098916:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.098925:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df76 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.098931:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df76 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.098951:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.098956:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fede00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127457.098960:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df76 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.098966:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df76 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.098976:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:0.0:1789127457.098979:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127457.098982:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df76 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.098987:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785df76 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.098996:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.099003:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.099008:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.099013:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127457.099015:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.099030:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.099038:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:0.0:1789127457.099040:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127457.099043:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127457.099048:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785df68 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127457.099163:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:11674:x1876035771635328:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 53118us (53284us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1789127457.099181:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 139 00000020:00080000:0.0:1789127457.099185:0:6522:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789127457.099401:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789127457.099406:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789127457.099935:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789127457.099943:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789127457.102289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127457.103063:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771635968 00000100:00100000:1.0:1789127457.103073:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771635968 00000100:00100000:1.0:1789127457.103125:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:1.0:1789127457.103141:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1baa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:11674:x1876035771635968:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789127457.103371:0:6526:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789127457.103398:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:1.0:1789127457.103426:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785df7d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.103459:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785df7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.103471:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785df7d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.103480:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785df7d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.103486:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785df7d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.103492:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785df7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.103536:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789127457.103622:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1baa050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:11674:x1876035771635968:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 481us (1340us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1789127457.103631:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000020:00080000:1.0:1789127457.103636:0:6526:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789127457.103646:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127457.103655:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785df7d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127457.103664:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858ce00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127457.103669:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785df7d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127457.103677:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785df7d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127457.103692:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:3.0:1789127457.103695:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789127457.103708:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785df7d lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127457.103715:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785df7d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127457.103720:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:3.0:1789127457.103735:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127457.103738:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127457.103740:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127457.104922:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771636224 00000100:00100000:1.0:1789127457.104932:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771636224 00000100:00100000:1.0:1789127457.105001:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 140 00000100:00100000:1.0:1789127457.105011:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:11673:x1876035771636224:12345-192.168.206.48@tcp:58:lfs.0 00000040:00080000:1.0:1789127457.105175:0:9447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789127457.105249:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:11673:x1876035771636224:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 239us (1532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127457.105257:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 140 00000100:00100000:0.0:1789127457.184708:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127457.184863:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771636352 00000100:00100000:2.0:1789127457.184872:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771636352 00000100:00100000:2.0:1789127457.184928:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 141 00000100:00100000:2.0:1789127457.184938:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:11676:x1876035771636352:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789127457.184960:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127457.184980:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785df84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffdbc expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.185059:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785df8b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.185074:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785df8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.185085:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785df8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.185111:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785df92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.185119:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785df92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.185125:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785df92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.185207:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785df99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.185218:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd7d expref: 22 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.185230:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785df99 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.185259:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd7d expref: 22 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.185272:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd7d expref: 22 pid: 9447 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127457.185286:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345887e0780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789537408:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127457.185393:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127457.189499:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345887e0780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789537408:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127457.189543:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785df99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127457.190850:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127457.191079:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771636608 00000100:00100000:1.0:1789127457.191100:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771636608 00000100:00100000:1.0:1789127457.191176:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:1.0:1789127457.191187:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690405680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:6640:x1876035771636608:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789127457.191405:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690405680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:6640:x1876035771636608:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 218us (569us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789127457.191414:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:3.0:1789127457.196925:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127457.197118:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771636736 00000100:00100000:1.0:1789127457.197128:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771636736 00010000:00010000:1.0:1789127457.197227:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd7d expref: 24 pid: 9447 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127457.197271:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 90 00000100:00100000:1.0:1789127457.197282:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690406d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:2402:x1876035771636736:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127457.197298:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127457.197305:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd7d expref: 24 pid: 9447 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.197318:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd7d expref: 24 pid: 9447 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.197340:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dea4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd7d expref: 24 pid: 9447 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.197356:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:1.0:1789127457.197361:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785df99 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.197387:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785df99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.197394:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785df99 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127457.197426:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127457.197613:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785df99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197622:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785df99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127457.197669:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789127457.197674:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127457.197693:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785df99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197705:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785df99 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197713:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785df8b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197719:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785df8b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197725:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785df8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197731:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6e00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127457.197735:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785df8b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197742:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785df8b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197750:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:2.0:1789127457.197761:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127457.197765:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785df8b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197772:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785df8b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197784:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785df92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197790:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785df92 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197796:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785df92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197801:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7a00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127457.197803:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785df92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197809:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785df92 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197817:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9346b7264f00) 00010000:00010000:2.0:1789127457.197820:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127457.197823:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785df92 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.197829:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785df92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127457.197945:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690406d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:2402:x1876035771636736:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 664us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127457.197954:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 90 00010000:00010000:2.0:1789127457.201301:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785df84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdbc expref: 23 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.201342:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785df99 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdbc expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127457.201352:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:2.0:1789127457.201355:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127457.201358:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7e00, rc 0) 00000100:00100000:2.0:1789127457.201435:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:11676:x1876035771636352:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 16498us (16735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127457.201445:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 141 00010000:00010000:0.0:1789127457.721564:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789127457.969921:0:15015:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127457.969929:0:15015:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127457.969957:0:15015:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789127457.969962:0:15015:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789127458.104869:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127458.104890:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690404f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789537536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127458.104957:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127458.106614:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789537536 00000100:00100000:0.0:1789127458.106632:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789537536 00000100:00100000:0.0:1789127458.106701:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789127458.106711:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789537536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127458.106746:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789127458.106811:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789537536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127458.106819:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789127458.106867:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690404f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789537536:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1789127458.107377:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789127458.107382:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127458.107409:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789127458.107415:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789127458.107546:0:14502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690404780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14502:1876035789537664:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789127458.107613:0:14502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346c1f63e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127458.112299:0:14502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690404780 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14502:1876035789537664:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789127458.124617:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127458.124849:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771636864 00000100:00100000:1.0:1789127458.124859:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771636864 00000100:00100000:1.0:1789127458.124935:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 142 00000100:00100000:1.0:1789127458.124945:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:11688:x1876035771636864:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000100:00080000:2.0:1789127458.124974:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:1.0:1789127458.124979:0:9447:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789127458.125093:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:11688:x1876035771636864:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 150us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127458.125101:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 142 00000100:00100000:1.0:1789127458.128095:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127458.128174:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771637120 00000100:00100000:0.0:1789127458.128183:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771637120 00000100:00100000:0.0:1789127458.128239:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 143 00000100:00100000:0.0:1789127458.128250:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:11688:x1876035771637120:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127458.128268:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127458.128289:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dfa0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffdc3 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127458.128382:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dfa7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127458.128395:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127458.128407:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dfa7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127458.128417:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789127458.128539:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785dfa0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdc3 expref: 25 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127458.128555:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dfa7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdc3 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127458.128564:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:0.0:1789127458.128567:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127458.128571:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fecc00, rc 0) 00000100:00100000:0.0:1789127458.128621:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:11688:x1876035771637120:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 373us (535us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789127458.128635:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 143 00000100:00100000:0.0:1789127458.133808:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127458.133861:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771637248 00000100:00100000:1.0:1789127458.133870:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771637248 00000100:00100000:1.0:1789127458.133926:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:1.0:1789127458.133934:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:2402:x1876035771637248:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127458.133948:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127458.133968:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785dfa7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdc3 expref: 24 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127458.133992:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:1.0:1789127458.133996:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127458.134156:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:2402:x1876035771637248:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 222us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127458.134174:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:0.0:1789127458.137316:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127458.150021:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771637504 00000100:00100000:1.0:1789127458.150034:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771637504 00000100:00100000:1.0:1789127458.150113:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 144 00000100:00100000:1.0:1789127458.150123:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:11688:x1876035771637504:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789127458.150208:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785dfb5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127458.150225:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785dfb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127458.150236:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785dfb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127458.150358:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785dfb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127458.150365:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785dfb5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127458.150371:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785dfb5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127458.150377:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127458.150390:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785dfb5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127458.150397:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785dfb5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127458.150409:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:1.0:1789127458.150411:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789127458.150415:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785dfb5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127458.150421:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785dfb5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127458.150572:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789127458.150576:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789127458.151080:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789127458.151089:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789127458.151211:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7faa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:11688:x1876035771637504:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 1087us (13904us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789127458.151221:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 144 00000100:00100000:0.0:1789127458.155992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127458.156256:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771637760 00000100:00100000:3.0:1789127458.156265:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771637760 00000100:00100000:3.0:1789127458.156314:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:3.0:1789127458.156325:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:11688:x1876035771637760:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789127458.156548:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+25:11688:x1876035771637760:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 225us (564us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789127458.156558:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:0.0:1789127458.616022:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789537792:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127458.616088:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127458.616233:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127458.616243:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789537920:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127458.616273:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127458.616442:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789537792 00000100:00100000:3.0:1789127458.616461:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789537792 00000100:00100000:3.0:1789127458.616502:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789127458.616544:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588768780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789537792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127458.616589:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789127458.616633:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588768780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789537792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127458.616640:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789127458.616662:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789538304:0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.616690:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127458.616710:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690404f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789538816:0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.616733:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127458.616765:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789537792:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127458.616779:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789127458.616784:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690404b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789538176:0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.616806:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127458.616823:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690404780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789538688:0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.616845:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127458.616858:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789539200:0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.616877:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127458.616900:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789538816 00000100:00100000:3.0:1789127458.616904:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789538816 00000100:00100000:3.0:1789127458.616937:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789538688 00000100:00100000:3.0:1789127458.616939:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789538688 00000100:00100000:3.0:1789127458.616953:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789539200 00000100:00100000:3.0:1789127458.616956:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789539200 00000100:00100000:3.0:1789127458.616969:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789127458.616975:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3653:x1876035789538816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.617020:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3653:x1876035789538816:12345-0@lo:400:kworker.0 Request processed in 45us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127458.617028:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789127458.617040:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789127458.617046:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789538688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.617071:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789538688:12345-0@lo:400:kworker.0 Request processed in 26us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127458.617077:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789127458.617087:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789127458.617093:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3653:x1876035789539200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.617116:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3653:x1876035789539200:12345-0@lo:400:kworker.0 Request processed in 24us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127458.617122:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1789127458.617136:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127458.617140:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127458.617149:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789538304 00000100:00100000:3.0:1789127458.617152:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789538304 00000100:00100000:3.0:1789127458.617184:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789538176 00000100:00100000:3.0:1789127458.617187:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789538176 00000100:00100000:3.0:1789127458.617202:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789127458.617207:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789538304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.617236:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789538304:12345-0@lo:400:kworker.0 Request processed in 28us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127458.617241:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789127458.617252:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789127458.617258:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789538176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.617297:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789538176:12345-0@lo:400:kworker.0 Request processed in 40us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127458.617304:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789127458.617332:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690404b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789538176:0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.617341:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690404780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789538688:0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.617350:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812aa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789539200:0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.617358:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789538304:0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.617367:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690404f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789538816:0@lo:400:kworker.0 00000100:00100000:1.0:1789127458.617537:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789538048:0@lo:400:kworker.0 00000100:00100000:1.0:1789127458.617581:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127458.617608:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789538560:0@lo:400:kworker.0 00000100:00100000:1.0:1789127458.617630:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127458.617647:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789539072:0@lo:400:kworker.0 00000100:00100000:1.0:1789127458.617677:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127458.617693:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789127458.617698:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789538432:0@lo:400:kworker.0 00000100:00100000:1.0:1789127458.617718:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127458.617726:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789538944:0@lo:400:kworker.0 00000100:00100000:1.0:1789127458.617744:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127458.617760:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789538560 00000100:00100000:1.0:1789127458.617764:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789538560 00000100:00100000:1.0:1789127458.617789:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789539072 00000100:00100000:1.0:1789127458.617792:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789539072 00000100:00100000:1.0:1789127458.617803:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789538432 00000100:00100000:1.0:1789127458.617805:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789538432 00000100:00100000:1.0:1789127458.617815:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789538944 00000100:00100000:1.0:1789127458.617817:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789538944 00000100:00100000:1.0:1789127458.617830:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789127458.617836:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789538560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127458.617870:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789538560:12345-0@lo:400:kworker.0 Request processed in 34us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127458.617876:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:1.0:1789127458.617889:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789127458.617895:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789539072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127458.617918:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fbb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789539072:12345-0@lo:400:kworker.0 Request processed in 24us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127458.617924:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789127458.617935:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789127458.617940:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789538432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127458.617962:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789538432:12345-0@lo:400:kworker.0 Request processed in 22us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127458.617973:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1789127458.617985:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1789127458.617991:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789538944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127458.618019:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789538944:12345-0@lo:400:kworker.0 Request processed in 29us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127458.618025:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00080000:1.0:1789127458.618039:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127458.618041:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127458.618058:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789538432:0@lo:400:kworker.0 00000100:00100000:1.0:1789127458.618066:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789538944:0@lo:400:kworker.0 00010000:00080000:1.0:1789127458.618076:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934690405a40 x1876035789538560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127458.618085:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789538560:0@lo:400:kworker.0 00010000:00080000:1.0:1789127458.618094:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346904061c0 x1876035789539072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127458.618102:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789539072:0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.619247:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789538048 00000100:00100000:3.0:1789127458.619258:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789538048 00000100:00100000:3.0:1789127458.619312:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1789127458.619321:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934688ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789538048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127458.619379:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934688ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789538048:12345-0@lo:400:kworker.0 Request processed in 59us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127458.619386:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:3.0:1789127458.619432:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789538048:0@lo:400:kworker.0 00000100:00100000:0.0:1789127458.619544:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789537920 00000100:00100000:0.0:1789127458.619550:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789537920 00000100:00100000:0.0:1789127458.619599:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789127458.619606:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789537920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789127458.619628:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127458.619664:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fb8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789537920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (3389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127458.619671:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00080000:3.0:1789127458.619830:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127458.619858:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789537920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127458.620099:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127458.620112:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789539328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127458.620167:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127458.620290:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789539328 00000100:00100000:0.0:1789127458.620294:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789539328 00000100:00100000:0.0:1789127458.620327:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789127458.620334:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1876035789539328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127458.620346:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127458.620384:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1876035789539328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127458.620391:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789127458.620458:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789539328:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789127458.743974:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127459.128197:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127459.128220:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789539456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127459.128281:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127459.128526:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458876a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789539584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127459.128552:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127459.128651:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789539456 00000100:00100000:0.0:1789127459.128659:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789539456 00000100:00100000:0.0:1789127459.128705:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789539584 00000100:00100000:0.0:1789127459.128709:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789539584 00000100:00100000:0.0:1789127459.128747:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789127459.128760:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1876035789539456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127459.128788:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789127459.128845:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3651:x1876035789539456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127459.128852:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789127459.128874:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789127459.128881:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789539584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789127459.128891:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789127459.128915:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789539584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 35us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127459.128921:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789127459.129209:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458876a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789539584:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127459.129225:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789539456:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789127459.768421:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789127459.952721:0:15067:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789127459.952728:0:15067:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789127459.952764:0:15067:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789127459.952770:0:15067:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789127460.133980:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127460.134093:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771638016 00000100:00100000:3.0:1789127460.134111:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771638016 00000100:00100000:3.0:1789127460.134192:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 145 00000100:00100000:3.0:1789127460.134204:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+25:11709:x1876035771638016:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127460.134225:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127460.134244:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dfbc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffdca expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127460.134343:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dfc3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127460.134365:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dfc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127460.134378:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dfc3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127460.134391:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789127460.134488:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785dfbc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdca expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127460.134505:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dfc3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdca expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127460.134537:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:3.0:1789127460.134540:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789127460.134543:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff000, rc 0) 00000100:00100000:3.0:1789127460.134595:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:11709:x1876035771638016:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 393us (623us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1789127460.134603:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 145 00000100:00080000:0.0:1789127460.134837:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127460.138440:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127460.138678:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771638144 00000100:00100000:1.0:1789127460.138688:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771638144 00000100:00100000:1.0:1789127460.138747:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 146 00000100:00100000:1.0:1789127460.138756:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:11709:x1876035771638144:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:1.0:1789127460.138817:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785dfd1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127460.138844:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785dfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127460.138856:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785dfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127460.138890:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785dfd1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127460.138897:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785dfd1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127460.138904:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785dfd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127460.138911:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858cc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127460.138915:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785dfd1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127460.138922:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785dfd1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127460.138933:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:1.0:1789127460.138936:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127460.138941:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785dfd1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127460.138947:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785dfd1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127460.139006:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:11709:x1876035771638144:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 250us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127460.139019:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 146 00000100:00100000:0.0:1789127460.260132:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127460.260802:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771638272 00000100:00100000:3.0:1789127460.260812:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771638272 00000100:00080000:0.0:1789127460.260886:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127460.260889:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:3.0:1789127460.260899:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771638272:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:3.0:1789127460.260918:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127460.261325:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020a3c7f2/0xd718aadfd785dfd8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffdd1 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127460.261353:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3eb1e, atime: 0x6aa3eb1e, ctime: 0x6aa3eb1e, blocks: 0x8 00010000:00010000:3.0:1789127460.261492:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=421s v=(0 0) 00010000:00010000:3.0:1789127460.261496:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127460.261545:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020a3c7f2/0xd718aadfd785dfd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdd1 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127460.261566:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000020a3c7f2/0xd718aadfd785dfd8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdd1 expref: 7 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127460.261577:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff400, rc 0) 00000100:00100000:3.0:1789127460.261626:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771638272:12345-192.168.206.48@tcp:101:cat.0 Request processed in 729us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127460.261632:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:0.0:1789127460.266329:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127460.266578:0:8444:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771638400 00000100:00100000:3.0:1789127460.266587:0:8444:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771638400 00002000:00100000:3.0:1789127460.266634:0:8444:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9346b7f9fc00 x1876035771638400/t0(0) o3->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:196/0 lens 488/0 e 0 to 0 dl 1789127471 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789127460.266645:0:8444:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9346b7f9fc00 with x1876035771638400 ext(0->4095) 00002000:00010000:3.0:1789127460.266661:0:8444:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9346b7f9fc00 00000100:00100000:3.0:1789127460.266752:0:8444:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:3.0:1789127460.266762:0:8444:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771638400:12345-192.168.206.48@tcp:3:cat.0 00000100:00100000:3.0:1789127460.266944:0:8444:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771638400:12345-192.168.206.48@tcp:3:cat.0 Request processed in 183us (623us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789127460.266952:0:8444:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00002000:00100000:3.0:1789127460.266959:0:8444:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9346b7f9fc00 x1876035771638400/t0(0) o3->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:196/0 lens 488/4536 e 0 to 0 dl 1789127471 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789127460.266967:0:8444:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9346b7f9fc00 with x1876035771638400 ext(0->4095) 00002000:00010000:3.0:1789127460.266970:0:8444:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9346b7f9fc00 00000001:00080000:2.0:1789127460.669933:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:0.0:1789127460.791804:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127461.240248:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789127461.240258:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789127461.240277:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789127461.240285:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789127461.375695:0:14505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789127461.407413:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127461.407459:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127461.407499:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127461.407549:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127461.407559:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771638528 00000100:00100000:3.0:1789127461.407570:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771638528 00000100:00100000:2.0:1789127461.407575:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127461.407600:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127461.407636:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 448 00000100:00100000:2.0:1789127461.407641:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127461.407650:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2402:x1876035771638528:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127461.407670:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771638656 00000100:00100000:2.0:1789127461.407675:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771638656 00000100:00100000:2.0:1789127461.407704:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771638784 00000100:00100000:2.0:1789127461.407707:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771638784 00000100:00100000:3.0:1789127461.407727:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1846450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2402:x1876035771638528:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 80us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127461.407736:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771639168 00000100:00100000:3.0:1789127461.407737:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 448 00000100:00100000:2.0:1789127461.407741:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771639168 00000100:00100000:2.0:1789127461.407758:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771639296 00000100:00100000:2.0:1789127461.407761:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771639296 00000100:00100000:2.0:1789127461.407780:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 327 00000100:00100000:2.0:1789127461.407788:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:2401:x1876035771638656:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127461.407837:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:2401:x1876035771638656:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 49us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127461.407844:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 327 00000100:00100000:2.0:1789127461.407861:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 328 00000100:00100000:2.0:1789127461.407869:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771638784:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127461.407907:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f09680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771638784:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 39us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127461.407908:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771638912 00000100:00100000:3.0:1789127461.407914:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771638912 00000100:00100000:2.0:1789127461.407919:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 328 00000100:00100000:2.0:1789127461.407936:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 329 00000100:00100000:2.0:1789127461.407944:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771639168:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127461.407947:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771639040 00000100:00100000:3.0:1789127461.407952:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771639040 00000100:00100000:3.0:1789127461.407979:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:2.0:1789127461.407990:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e861c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771639168:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 46us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127461.407997:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 329 00000100:00100000:3.0:1789127461.408002:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771638912:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127461.408015:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 330 00000100:00100000:2.0:1789127461.408024:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771639296:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127461.408040:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771638912:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 52us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127461.408055:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e852c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771639296:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 31us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127461.408063:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:2.0:1789127461.408067:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 330 00000100:00100000:3.0:1789127461.408087:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00080000:2.0:1789127461.408097:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127461.408098:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771639040:12345-192.168.206.48@tcp:400:kworker.0 00000100:00080000:2.0:1789127461.408103:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127461.408108:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127461.408132:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771639040:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 36us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127461.408139:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 122 00010000:00010000:1.0:1789127461.816647:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789127462.717572:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1789127462.717588:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:2.0:1789127462.718860:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1789127462.718890:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff934690351180 refcount 2 committed 0 result 0 batchid 4 00010000:00010000:0.0:1789127462.718894:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785df53 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789127462.718895:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9346c1ea0300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff934690351e40 00000020:00080000:2.0:1789127462.718899:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9346c1ea0d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff934587b00000 00010000:00010000:0.0:1789127462.718918:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785df53 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127462.718925:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785df53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789127462.718927:0:6501:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:0.0:1789127462.718932:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fedc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127462.718936:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785df53 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127462.718944:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785df53 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127462.718960:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9346a69cbd00) 00010000:00010000:0.0:1789127462.718963:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127462.718968:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785df53 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127462.718974:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785df53 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789127462.719042:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789127462.719106:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1789127462.839901:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127463.226472:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127463.226493:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789539712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127463.226580:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127463.230648:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789539712 00000100:00100000:2.0:1789127463.230661:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789539712 00000100:00100000:2.0:1789127463.230713:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789127463.230722:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789539712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127463.230756:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789127463.230834:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789539712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (4253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127463.230843:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789127463.231623:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fba940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789539712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127463.738731:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127463.738755:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789539840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127463.738822:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127463.738888:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789539840 00000100:00100000:1.0:1789127463.738895:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789539840 00000100:00100000:1.0:1789127463.738941:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789127463.738950:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789539840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789127463.738979:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127463.739017:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fbad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789539840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127463.739024:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789127463.739055:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1789127463.739060:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:1.0:1789127463.739076:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff934587ff8f00, transno 4294967305 00000100:00100000:1.0:1789127463.739093:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789539840:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789127463.739284:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127463.741712:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789540096:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127463.741809:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127463.741871:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127463.741879:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789539968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127463.741911:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127463.741952:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789540096 00000100:00100000:1.0:1789127463.741960:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789540096 00000100:00100000:1.0:1789127463.742011:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789127463.742020:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789540096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127463.742062:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789127463.742124:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789540096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127463.742241:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789127463.742270:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789539968 00000100:00100000:1.0:1789127463.742274:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789539968 00000100:00100000:1.0:1789127463.742311:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789127463.742318:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346bfa86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789539968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789127463.742333:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789127463.742382:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346bfa86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789539968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127463.742390:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1789127463.742417:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127463.742718:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587838780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789540352:0@lo:400:kworker.0 00000100:00100000:1.0:1789127463.742744:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7391a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789540608:0@lo:400:kworker.0 00000100:00100000:2.0:1789127463.742793:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127463.742847:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789540224:0@lo:400:kworker.0 00000100:00100000:2.0:1789127463.742860:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789540864:0@lo:400:kworker.0 00000100:00100000:3.0:1789127463.742949:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458783ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789540480:0@lo:400:kworker.0 00000100:00100000:2.0:1789127463.748728:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127463.748825:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789540352 00000100:00100000:2.0:1789127463.748834:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789540352 00000100:00100000:2.0:1789127463.748880:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789127463.748890:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7deda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789540352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127463.748948:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7deda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789540352:12345-0@lo:400:kworker.0 Request processed in 60us (6159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127463.748957:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789127463.748993:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127463.749025:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934586046580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789541120:0@lo:400:kworker.0 00000100:00100000:2.0:1789127463.749058:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127463.749106:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789539968:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127463.749127:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789540096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127463.749171:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789540608 00000100:00100000:2.0:1789127463.749175:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789540608 00000100:00100000:2.0:1789127463.749205:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789541120 00000100:00100000:2.0:1789127463.749208:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789541120 00000100:00100000:2.0:1789127463.749229:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789127463.749236:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789540608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127463.749295:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789540608:12345-0@lo:400:kworker.0 Request processed in 60us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127463.749319:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789127463.749333:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789127463.749340:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789541120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127463.749370:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789541120:12345-0@lo:400:kworker.0 Request processed in 31us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127463.749376:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00080000:2.0:1789127463.749396:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127463.749417:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587838780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789540352:0@lo:400:kworker.0 00000100:00100000:2.0:1789127463.749439:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7391a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789540608:0@lo:400:kworker.0 00000100:00100000:2.0:1789127463.749448:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586046580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789541120:0@lo:400:kworker.0 00000100:00100000:2.0:1789127463.749484:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789540864 00000100:00100000:2.0:1789127463.749488:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789540864 00000100:00100000:2.0:1789127463.749542:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789127463.749549:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7def840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789540864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127463.749585:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7def840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789540864:12345-0@lo:400:kworker.0 Request processed in 37us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127463.749592:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1789127463.749608:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127463.749625:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934586047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789540864:0@lo:400:kworker.0 00000100:00100000:1.0:1789127463.752950:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127463.753035:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7390b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789540736:0@lo:400:kworker.0 00000100:00100000:1.0:1789127463.753431:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127463.753479:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789541248:0@lo:400:kworker.0 00000100:00100000:1.0:1789127463.753534:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127463.753584:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789540736 00000100:00100000:1.0:1789127463.753593:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789540736 00000100:00100000:2.0:1789127463.753607:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789540224 00000100:00100000:2.0:1789127463.753615:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789540224 00000100:00100000:1.0:1789127463.753665:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789541248 00000100:00100000:1.0:1789127463.753669:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789541248 00000100:00100000:2.0:1789127463.753671:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:2.0:1789127463.753685:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789540224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127463.753703:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789127463.753713:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789540736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127463.753765:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789540224:12345-0@lo:400:kworker.0 Request processed in 83us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127463.753771:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789540736:12345-0@lo:400:kworker.0 Request processed in 58us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127463.753791:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1789127463.753791:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1789127463.753818:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1789127463.753827:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789541248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127463.753860:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fbad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3652:x1876035789541248:12345-0@lo:400:kworker.0 Request processed in 35us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127463.753868:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:2.0:1789127463.753870:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127463.753918:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789540224:0@lo:400:kworker.0 00010000:00080000:1.0:1789127463.753938:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7390b40 x1876035789540736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127463.753950:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7390b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789540736:0@lo:400:kworker.0 00010000:00080000:1.0:1789127463.753961:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7dede00 x1876035789541248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127463.753969:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7dede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789541248:0@lo:400:kworker.0 00000100:00100000:3.0:1789127463.754238:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127463.754261:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345860443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789540992:0@lo:400:kworker.0 00000100:00100000:3.0:1789127463.754293:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127463.754922:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789540480 00000100:00100000:2.0:1789127463.754930:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789540480 00000100:00100000:2.0:1789127463.754984:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1789127463.754994:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789540480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127463.755052:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789540480:12345-0@lo:400:kworker.0 Request processed in 60us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127463.755059:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:3.0:1789127463.755245:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458783ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789540480:0@lo:400:kworker.0 00000100:00100000:1.0:1789127463.757686:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789540992 00000100:00100000:1.0:1789127463.757706:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789540992 00000100:00100000:1.0:1789127463.757809:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789127463.757826:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789540992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127463.757939:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789540992:12345-0@lo:400:kworker.0 Request processed in 116us (3644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127463.757948:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789127463.757972:0:3650:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1789127463.757981:0:3650:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9346b7fb9e00, transno 4294967311 00000004:00080000:3.0:1789127463.757996:0:3650:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1789127463.758026:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345860443c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789540992:0@lo:400:kworker.0 00000100:00080000:2.0:1789127463.758265:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789127463.870921:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127464.247741:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127464.247765:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346812a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789541376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127464.247839:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127464.247969:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789541376 00000100:00100000:2.0:1789127464.247977:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789541376 00000100:00100000:3.0:1789127464.248102:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789541504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127464.248144:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127464.251639:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789541504 00000100:00100000:0.0:1789127464.251656:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789541504 00000100:00100000:2.0:1789127464.254190:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789127464.254208:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789541376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127464.254242:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789127464.254330:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812a92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789541376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (6490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127464.254337:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789127464.254391:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346812a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789541376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127464.256010:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789127464.256032:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789541504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789127464.256060:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789127464.256142:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690404000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789541504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (7997us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127464.256149:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789127464.267686:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789541504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127464.679747:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127464.679848:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771639424 00000100:00100000:1.0:1789127464.679857:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771639424 00000100:00100000:1.0:1789127464.679938:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 147 00000100:00100000:1.0:1789127464.679948:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+13:11353:x1876035771639424:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789127464.680054:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+13:11353:x1876035771639424:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 Request processed in 107us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127464.680061:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 147 00000100:00080000:2.0:1789127464.680538:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127464.696346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127464.696438:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771639552 00000100:00100000:0.0:1789127464.696447:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771639552 00000100:00100000:0.0:1789127464.696543:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 148 00000100:00100000:0.0:1789127464.696553:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345860443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:11353:x1876035771639552:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789127464.696637:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345860443c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:11353:x1876035771639552:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 Request processed in 86us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127464.696644:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 148 00000100:00080000:2.0:1789127464.697380:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127464.701543:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127464.701669:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771639808 00000100:00100000:1.0:1789127464.701680:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771639808 00000100:00100000:1.0:1789127464.701735:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:1.0:1789127464.701745:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+13:11353:x1876035771639808:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789127464.703227:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:11353:x1876035771639808:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 1476us (1722us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789127464.703237:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00010000:00010000:1.0:1789127464.887786:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127464.929742:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127464.929898:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771639936 00000100:00100000:2.0:1789127464.929908:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771639936 00000100:00100000:2.0:1789127464.929983:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 149 00000100:00100000:2.0:1789127464.929992:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:12167:x1876035771639936:12345-192.168.206.48@tcp:101:lsof.0 00010000:00010000:2.0:1789127464.930012:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127464.930047:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dfdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffdd8 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127464.930106:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dfe6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127464.930118:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127464.930143:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127464.930185:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789127464.930188:0:9447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127464.930222:0:9447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dfe6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127464.930244:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785dfdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdd8 expref: 7 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127464.930259:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdd8 expref: 6 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127464.930266:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346b7218d00) 00010000:00010000:2.0:1789127464.930268:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127464.930271:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6c00, rc 0) 00000100:00100000:2.0:1789127464.930327:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:12167:x1876035771639936:12345-192.168.206.48@tcp:101:lsof.0 Request processed in 336us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127464.930335:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 149 00000100:00080000:0.0:1789127464.931066:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789127465.911750:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127466.494728:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127466.494789:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127466.494812:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127466.494835:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127466.494849:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127466.494866:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127466.494893:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127466.494913:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771640576 00000100:00100000:2.0:1789127466.494920:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771640576 00000100:00100000:2.0:1789127466.494966:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771640448 00000100:00100000:2.0:1789127466.494968:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771640448 00000100:00100000:2.0:1789127466.494984:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:2.0:1789127466.494991:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586046580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771640576:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127466.495063:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586046580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771640576:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 72us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127466.495070:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:2.0:1789127466.495083:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:2.0:1789127466.495088:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458783ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771640448:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127466.495108:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458783ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771640448:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 20us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127466.495113:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:2.0:1789127466.495143:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771640320 00000100:00100000:2.0:1789127466.495145:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771640320 00000100:00100000:2.0:1789127466.495163:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771640832 00000100:00100000:2.0:1789127466.495165:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771640832 00000100:00100000:2.0:1789127466.495174:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771640192 00000100:00100000:2.0:1789127466.495175:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771640192 00000100:00100000:2.0:1789127466.495185:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771640704 00000100:00100000:2.0:1789127466.495186:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771640704 00000100:00100000:2.0:1789127466.495205:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 337 00000100:00100000:2.0:1789127466.495210:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934586047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771640320:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127466.495236:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934586047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771640320:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 26us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127466.495242:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 337 00000100:00100000:2.0:1789127466.495253:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 338 00000100:00100000:2.0:1789127466.495258:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7390b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771640832:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127466.495277:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7390b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771640832:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 20us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127466.495282:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 338 00000100:00100000:2.0:1789127466.495291:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 339 00000100:00100000:2.0:1789127466.495295:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7391a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:2401:x1876035771640192:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127466.495315:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7391a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:2401:x1876035771640192:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 20us (465us total) trans 0 rc 0/0 00000100:00080000:0.0:1789127466.495412:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127466.495417:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127466.495419:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127466.495421:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127466.495432:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 340 00000100:00100000:0.0:1789127466.495440:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2401:x1876035771640704:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127466.495464:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2401:x1876035771640704:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 26us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127466.495468:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 340 00000100:00100000:2.0:1789127466.495903:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 339 00000100:00100000:3.0:1789127466.496342:0:14500:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771640064 00000100:00100000:3.0:1789127466.496348:0:14500:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771640064 00000100:00100000:3.0:1789127466.496673:0:14500:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 450 00000100:00100000:3.0:1789127466.496681:0:14500:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771640064:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127466.496717:0:14500:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771640064:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 38us (1998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127466.496723:0:14500:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 450 00010000:00010000:0.0:1789127466.936551:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127467.960587:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127468.346093:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789541632:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127468.346250:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127468.346799:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789541632 00000100:00100000:2.0:1789127468.346808:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789541632 00000100:00100000:2.0:1789127468.346956:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789127468.346966:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690405a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789541632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127468.346998:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789127468.347060:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690405a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789541632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127468.347067:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789127468.347147:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789541632:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127468.856327:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789541888:0@lo:400:kworker.0 00000100:00100000:2.0:1789127468.856409:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127468.856456:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458856fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789542400:0@lo:400:kworker.0 00000100:00100000:2.0:1789127468.856481:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127468.856504:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789542912:0@lo:400:kworker.0 00000100:00100000:2.0:1789127468.856551:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127468.856583:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789127468.856590:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789541760:0@lo:400:kworker.0 00000100:00100000:2.0:1789127468.856617:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127468.856651:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458856da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789542272:0@lo:400:kworker.0 00000100:00100000:2.0:1789127468.856676:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127468.856693:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789542784:0@lo:400:kworker.0 00000100:00100000:2.0:1789127468.856716:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127468.856732:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789543296:0@lo:400:kworker.0 00000100:00100000:2.0:1789127468.856751:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127468.857292:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127468.857304:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789543424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127468.857336:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127468.857366:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458856cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789542144:0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.857391:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127468.857408:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789542656:0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.857429:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127468.857447:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789543168:0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.857467:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127468.857496:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789542272 00000100:00100000:3.0:1789127468.857502:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789542272 00000100:00100000:3.0:1789127468.857557:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789543424 00000100:00100000:3.0:1789127468.857560:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789543424 00000100:00100000:3.0:1789127468.857574:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789127468.857582:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789542272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.857641:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e530c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789542272:12345-0@lo:400:kworker.0 Request processed in 59us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.857656:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789127468.857674:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789127468.857680:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789543424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127468.857704:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789127468.857740:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789543424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.857747:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789127468.857764:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789541888 00000100:00100000:3.0:1789127468.857768:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789541888 00000100:00100000:3.0:1789127468.857869:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789542400 00000100:00100000:3.0:1789127468.857872:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789542400 00000100:00100000:3.0:1789127468.857896:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789542912 00000100:00100000:3.0:1789127468.857899:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789542912 00000100:00100000:3.0:1789127468.857912:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789542144 00000100:00100000:3.0:1789127468.857915:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789542144 00000100:00100000:3.0:1789127468.857928:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789127468.857935:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690403c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789541888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.857969:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690403c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789541888:12345-0@lo:400:kworker.0 Request processed in 35us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.857975:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:3.0:1789127468.857987:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789127468.857992:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789542400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858020:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e50b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789542400:12345-0@lo:400:kworker.0 Request processed in 28us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.858025:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:3.0:1789127468.858035:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789127468.858041:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789542912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858076:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e52580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789542912:12345-0@lo:400:kworker.0 Request processed in 36us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.858082:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789127468.858093:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789127468.858098:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690404f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789542144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858143:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690404f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789542144:12345-0@lo:400:kworker.0 Request processed in 44us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.858149:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1789127468.858167:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789542784 00000100:00100000:3.0:1789127468.858171:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789542784 00000100:00100000:3.0:1789127468.858197:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789543296 00000100:00100000:3.0:1789127468.858200:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789543296 00000100:00100000:3.0:1789127468.858212:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789542656 00000100:00100000:3.0:1789127468.858215:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789542656 00000100:00100000:3.0:1789127468.858225:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789543168 00000100:00100000:3.0:1789127468.858227:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789543168 00000100:00100000:3.0:1789127468.858238:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789127468.858244:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789542784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858275:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e52940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789542784:12345-0@lo:400:kworker.0 Request processed in 31us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.858281:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789127468.858293:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789127468.858299:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e51e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789543296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858325:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e51e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789543296:12345-0@lo:400:kworker.0 Request processed in 26us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.858330:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789127468.858341:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789127468.858354:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690406580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789542656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858385:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690406580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789542656:12345-0@lo:400:kworker.0 Request processed in 32us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.858390:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789127468.858403:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1789127468.858409:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690404780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789543168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858434:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690404780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789543168:12345-0@lo:400:kworker.0 Request processed in 26us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.858440:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:3.0:1789127468.858465:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127468.858469:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127468.858471:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127468.858527:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789543424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127468.858560:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458856cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789542144:0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858570:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789542656:0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858579:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789543168:0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858608:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458856da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789542272:0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858618:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789542784:0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858626:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789543296:0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858636:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789541888:0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858645:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458856fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789542400:0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858654:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789542912:0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.858708:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789541760 00000100:00100000:3.0:1789127468.858712:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789541760 00000100:00100000:3.0:1789127468.858740:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1789127468.858746:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789541760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.859346:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789541760:12345-0@lo:400:kworker.0 Request processed in 598us (2725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.859362:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1789127468.859414:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789541760:0@lo:400:kworker.0 00000100:00100000:2.0:1789127468.859528:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458856c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789542016:0@lo:400:kworker.0 00000100:00100000:2.0:1789127468.859568:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127468.859596:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458856ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789542528:0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.863028:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789542016 00000100:00100000:3.0:1789127468.863044:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789542016 00000100:00100000:3.0:1789127468.863115:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789127468.863126:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789542016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.863209:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789542016:12345-0@lo:400:kworker.0 Request processed in 85us (3639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.863217:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789127468.863357:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127468.863394:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690401e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789543040:0@lo:400:kworker.0 00000100:00100000:2.0:1789127468.863432:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127468.863471:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458856c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789542016:0@lo:400:kworker.0 00000100:00100000:2.0:1789127468.863598:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934687b75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789543552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127468.863625:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127468.863663:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127468.863669:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934687b74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789543680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127468.863694:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127468.863722:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789543552 00000100:00100000:2.0:1789127468.863726:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789543552 00000100:00100000:2.0:1789127468.863755:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789543680 00000100:00100000:2.0:1789127468.863758:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789543680 00000100:00100000:2.0:1789127468.864870:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789127468.864887:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789543552:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127468.865049:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789127468.865059:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789543680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127468.865079:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127468.865156:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b76580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789543680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (1462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.865163:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789127468.865190:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789542528 00000100:00100000:3.0:1789127468.865195:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789542528 00000100:00100000:3.0:1789127468.865225:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789543040 00000100:00100000:3.0:1789127468.865228:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789543040 00000100:00100000:3.0:1789127468.865239:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789127468.865250:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789542528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.865280:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789542528:12345-0@lo:400:kworker.0 Request processed in 30us (5659us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.865286:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:3.0:1789127468.865297:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1789127468.865302:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789543040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127468.865323:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789543040:12345-0@lo:400:kworker.0 Request processed in 21us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127468.865328:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00080000:3.0:1789127468.865344:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:2.0:1789127468.865411:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127468.865439:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789543552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 560us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127468.865445:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789127468.867614:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934687b74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789543680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127468.868461:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934687b75a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789543552:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789127468.868481:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93458856ed00 x1876035789542528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127468.868492:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458856ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789542528:0@lo:400:kworker.0 00010000:00080000:3.0:1789127468.868505:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934690401e00 x1876035789543040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127468.868556:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690401e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789543040:0@lo:400:kworker.0 00000001:00080000:3.0:1789127468.869164:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1789127468.869176:0:6501:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1789127468.871051:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1789127468.871068:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:0.0:1789127468.960255:0:15264:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 07:51:06 (1789127466) 00010000:00010000:1.0:1789127468.989155:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127469.367884:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127469.367915:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789543808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127469.367988:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127469.368066:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789543808 00000100:00100000:2.0:1789127469.368073:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789543808 00000100:00100000:2.0:1789127469.368123:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789127469.368131:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b75a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789543808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127469.368157:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789127469.368200:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b75a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789543808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127469.368206:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789127469.368251:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789543808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127469.368914:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934687b74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789543936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127469.368962:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127469.369182:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789543936 00000100:00100000:2.0:1789127469.369188:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789543936 00000100:00100000:2.0:1789127469.369241:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789127469.369249:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690404b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789543936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789127469.369264:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789127469.369307:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690404b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789543936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127469.369321:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789127469.369495:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934687b74b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789543936:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789127470.007753:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127470.227289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127470.230779:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771641088 00000100:00100000:0.0:1789127470.230794:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771641088 00000100:00100000:0.0:1789127470.230887:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 150 00000100:00100000:0.0:1789127470.230901:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+13:12434:x1876035771641088:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127470.230931:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127470.230953:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dfed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffddf expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231022:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dff4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231035:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dff4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231046:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dff4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231061:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dffb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231067:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dffb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231073:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dffb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231176:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e002 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231185:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e002 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231211:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e002 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127470.231222:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789127470.231301:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dff4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231308:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dff4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231315:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dff4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231321:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127470.231325:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dff4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231332:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dff4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231343:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9346a69cb900) 00010000:00010000:0.0:1789127470.231346:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127470.231349:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dff4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231355:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785dff4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231365:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dffb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231371:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dffb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231383:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dffb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231389:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fede00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127470.231392:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dffb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231398:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dffb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231406:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9346a69cbe00) 00010000:00010000:0.0:1789127470.231408:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127470.231411:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dffb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231416:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785dffb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231741:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785dfed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffddf expref: 16 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231754:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e002 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffddf expref: 15 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127470.231761:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4200) 00010000:00010000:0.0:1789127470.231763:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127470.231766:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec400, rc 0) 00000100:00100000:0.0:1789127470.231823:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:12434:x1876035771641088:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 927us (4543us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789127470.231839:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 150 00000100:00080000:3.0:1789127470.232663:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127470.235264:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127470.235372:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771641216 00000100:00100000:3.0:1789127470.235381:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771641216 00000100:00100000:3.0:1789127470.235438:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 151 00000100:00100000:3.0:1789127470.235447:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:12434:x1876035771641216:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789127470.237544:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fb92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:12434:x1876035771641216:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 Request processed in 2088us (2276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127470.237558:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 151 00000100:00100000:1.0:1789127470.240559:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127470.240622:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771641344 00000100:00100000:3.0:1789127470.240632:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771641344 00000100:00100000:3.0:1789127470.240760:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:3.0:1789127470.240784:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:2402:x1876035771641344:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127470.240802:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127470.240828:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e002 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffddf expref: 15 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127470.240846:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4200) 00010000:00010000:3.0:1789127470.240851:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127470.240918:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fb9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:2402:x1876035771641344:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 148us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127470.240926:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:0.0:1789127470.244885:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127470.244967:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771641472 00000100:00100000:3.0:1789127470.244976:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771641472 00000100:00100000:3.0:1789127470.245035:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 152 00000100:00100000:3.0:1789127470.245045:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:12434:x1876035771641472:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789127470.245220:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127470.245282:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:12434:x1876035771641472:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 Request processed in 237us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127470.245613:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 152 00000040:00080000:2.0:1789127470.458434:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127470.458442:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127470.459300:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789127470.459310:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789127470.584854:0:14505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789127471.032752:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127471.487068:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789127471.487075:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789127471.487307:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1789127471.487314:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789127471.611043:0:14505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789127471.613042:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127471.613097:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127471.613131:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127471.613142:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771641728 00000100:00100000:2.0:1789127471.613152:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771641728 00000100:00100000:0.0:1789127471.613160:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127471.613189:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127471.613210:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127471.613213:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771642240 00000100:00100000:2.0:1789127471.613218:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771642240 00000100:00100000:2.0:1789127471.613246:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771641856 00000100:00100000:2.0:1789127471.613249:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771641856 00000100:00100000:2.0:1789127471.613267:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 347 00000100:00100000:2.0:1789127471.613276:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:2402:x1876035771641728:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127471.613287:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127471.613308:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771641600 00000100:00100000:0.0:1789127471.613313:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771641600 00000100:00100000:0.0:1789127471.613343:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 452 00000100:00100000:0.0:1789127471.613354:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771641600:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127471.613356:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:2402:x1876035771641728:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 78us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127471.613368:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 347 00000100:00100000:2.0:1789127471.613386:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771642368 00000100:00100000:2.0:1789127471.613390:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771642368 00000100:00100000:0.0:1789127471.613391:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771641600:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 38us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127471.613400:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 452 00000100:00100000:2.0:1789127471.613416:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 348 00000100:00100000:2.0:1789127471.613430:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2402:x1876035771642240:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127471.613452:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 349 00000100:00100000:2.0:1789127471.613461:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2402:x1876035771642240:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 36us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127471.613464:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771641856:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127471.613494:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 348 00000100:00100000:0.0:1789127471.613500:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771641856:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 39us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127471.613533:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 349 00000100:00100000:3.0:1789127471.613640:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771641984 00000100:00100000:3.0:1789127471.613645:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771641984 00000100:00100000:3.0:1789127471.613675:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771642112 00000100:00100000:3.0:1789127471.613678:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771642112 00000100:00100000:3.0:1789127471.613702:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:3.0:1789127471.613711:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771641984:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127471.613743:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771641984:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 34us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127471.613749:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:3.0:1789127471.613760:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:3.0:1789127471.613766:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771642112:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127471.613786:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771642112:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 21us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127471.613792:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:2.0:1789127471.616214:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 350 00000100:00100000:2.0:1789127471.616234:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771642368:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127471.616298:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771642368:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 72us (3012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127471.616306:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 350 00000100:00080000:2.0:1789127471.616339:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127471.616344:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127471.616347:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127471.616350:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789127472.058238:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127472.796450:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127472.796507:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771642496 00000100:00100000:0.0:1789127472.796542:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771642496 00000100:00080000:3.0:1789127472.796607:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127472.796612:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 153 00000100:00100000:0.0:1789127472.796624:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:12476:x1876035771642496:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127472.796642:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127472.796661:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e010 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffde6 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796719:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e017 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796730:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e017 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796740:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e017 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796753:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e01e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796759:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e01e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796765:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e01e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796802:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e017 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796808:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e017 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796814:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e017 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796825:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127472.796830:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e017 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796838:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e017 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796849:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346b7218d00) 00010000:00010000:0.0:1789127472.796852:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127472.796857:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e017 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796863:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e017 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796875:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e01e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796880:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e01e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796885:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e01e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796889:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fecc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127472.796892:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e01e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.796897:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e01e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.797398:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9346a69cbe00) 00010000:00010000:0.0:1789127472.797401:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127472.797405:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e01e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.797411:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e01e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.797445:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e010 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffde6 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.797456:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346b7218d00) 00010000:00010000:0.0:1789127472.797458:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127472.797462:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e010 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffde6 expref: 15 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.797471:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec000, rc 0) 00000100:00100000:0.0:1789127472.797551:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:12476:x1876035771642496:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 930us (1110us total) trans 0 rc 301/301 00000100:00100000:0.0:1789127472.797560:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 153 00000100:00100000:2.0:1789127472.816277:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127472.819284:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771642752 00000100:00100000:0.0:1789127472.819296:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771642752 00000100:00100000:0.0:1789127472.819359:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 154 00000100:00100000:0.0:1789127472.819369:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687b74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+14:12476:x1876035771642752:12345-192.168.206.48@tcp:36:lfs.0 00010000:00010000:0.0:1789127472.819421:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127472.819448:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785d964 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc0a expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.819480:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346b7218d00) 00010000:00010000:0.0:1789127472.819485:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127472.819558:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.819572:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dfe6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdd8 expref: 5 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.819580:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.819612:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdd8 expref: 5 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.819625:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dfe6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdd8 expref: 5 pid: 9447 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127472.819637:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7f9ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789544064:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127472.819730:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127472.838473:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127472.838616:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7f9ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789544064:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127472.838642:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127472.839211:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771642880 00000100:00100000:1.0:1789127472.839219:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771642880 00010000:00010000:1.0:1789127472.839257:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dfe6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdd8 expref: 6 pid: 9447 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127472.839417:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 91 00000100:00100000:1.0:1789127472.839428:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2402:x1876035771642880:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127472.839444:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127472.839451:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dfe6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdd8 expref: 6 pid: 9447 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127472.839464:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dfe6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdd8 expref: 6 pid: 9447 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127472.839486:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785dfe6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdd8 expref: 6 pid: 9447 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127472.839499:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346b7218d00) 00010000:00010000:1.0:1789127472.839504:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127472.839540:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127472.839555:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127472.839579:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127472.839629:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771642880:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 203us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127472.839637:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 91 00010000:00010000:0.0:1789127472.840352:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.840364:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.840389:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e02c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.840411:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e02c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.840419:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e02c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.842589:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e033 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.842611:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e033 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.842622:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e033 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127472.842640:0:6522:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d38a5af7 reply state 0000000079f800fd transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e033 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.842651:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e033 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.842658:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:0.0:1789127472.842661:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127472.842664:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789127472.842670:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789127472.842678:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.842684:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.842690:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.842704:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127472.842708:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.842716:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.842727:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9346b7218d00) 00010000:00010000:0.0:1789127472.842730:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127472.842734:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.842740:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e025 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127472.842759:0:6522:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d38a5af7 reply state 0000000079f800fd transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e02c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.842767:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e02c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127472.842773:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9346a69cbe00) 00010000:00010000:0.0:1789127472.842776:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127472.842778:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789127472.842869:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687b74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:12476:x1876035771642752:12345-192.168.206.48@tcp:36:lfs.0 Request processed in 23498us (26597us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1789127472.842878:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 154 00000100:00100000:0.0:1789127473.003893:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127473.003983:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771643008 00000100:00100000:3.0:1789127473.004003:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771643008 00000100:00100000:3.0:1789127473.004060:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 155 00000100:00100000:3.0:1789127473.004071:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+15:12484:x1876035771643008:12345-192.168.206.48@tcp:101:lctl.0 00010000:00010000:3.0:1789127473.004127:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127473.004148:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e03a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffded expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.004210:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785e041 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.004222:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785e041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.004232:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785e041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127473.004275:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789127473.004278:0:9447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127473.004300:0:9447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785e041 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.004322:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e03a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffded expref: 17 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.004339:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785e041 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffded expref: 16 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.004347:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586f6bb00) 00010000:00010000:3.0:1789127473.004349:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127473.004353:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe600, rc 0) 00000100:00100000:3.0:1789127473.004411:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:12484:x1876035771643008:12345-192.168.206.48@tcp:101:lctl.0 Request processed in 343us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127473.004418:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 155 00000100:00100000:1.0:1789127473.076776:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127473.077016:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771643136 00000100:00100000:2.0:1789127473.077026:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771643136 00000100:00100000:2.0:1789127473.077097:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 156 00000100:00100000:2.0:1789127473.077108:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7dede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+16:12490:x1876035771643136:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1789127473.077125:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127473.077144:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e048 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffdf4 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077202:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e04f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077215:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e04f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077225:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e04f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077254:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e056 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077262:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077268:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077341:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785e05d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077349:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785e05d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077356:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785e05d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127473.077391:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789127473.077395:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127473.077425:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785e05d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077437:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e04f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077444:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e04f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077460:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e04f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077476:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127473.077481:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e04f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077489:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e04f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077501:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586f6bb00) 00010000:00010000:2.0:1789127473.077504:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127473.077556:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e04f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077563:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e04f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077578:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e056 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077583:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e056 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077588:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077592:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7a00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127473.077594:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e056 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077599:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e056 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077628:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9346a69cbe00) 00010000:00010000:2.0:1789127473.077631:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127473.077635:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e056 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077640:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e056 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077664:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e048 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdf4 expref: 18 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077677:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785e05d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdf4 expref: 17 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.077683:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:2.0:1789127473.077686:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789127473.077688:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7800, rc 0) 00000100:00100000:2.0:1789127473.078058:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7dede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+17:12490:x1876035771643136:12345-192.168.206.48@tcp:101:bash.0 Request processed in 952us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.078067:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 156 00010000:00010000:0.0:1789127473.079683:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127473.080571:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127473.080650:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771643392 00000100:00100000:3.0:1789127473.080659:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771643392 00000100:00100000:3.0:1789127473.080720:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 157 00000100:00100000:3.0:1789127473.080731:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+17:12490:x1876035771643392:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1789127473.080749:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127473.080779:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e064 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffdfb expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.080875:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785e06b lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.080888:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785e06b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.080898:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785e06b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.082343:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785e072 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.082360:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785e072 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.082369:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785e072 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789127473.082729:0:9447:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789127473.082842:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785e079 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.082852:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785e079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.082866:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785e079 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.082895:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785e06b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.082902:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785e06b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.082908:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785e06b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.082913:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ffa00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127473.082917:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785e06b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.082923:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785e06b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.082934:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:3.0:1789127473.082938:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127473.082942:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785e06b lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.082948:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785e06b lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127473.082959:0:9447:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e1bca7fc reply state 00000000bfde24bf transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785e072 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.082969:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785e072 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.082980:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff934586f6b300) 00010000:00010000:3.0:1789127473.082983:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127473.082985:0:9447:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789127473.083016:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e064 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdfb expref: 20 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.083029:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785e079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdfb expref: 19 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.083037:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff934586f6b400) 00010000:00010000:3.0:1789127473.083039:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127473.083041:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a1c00, rc 0) 00000100:00100000:3.0:1789127473.083107:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:12490:x1876035771643392:12345-192.168.206.48@tcp:101:bash.0 Request processed in 2379us (2542us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789127473.083115:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 157 00000100:00100000:1.0:1789127473.090190:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127473.090276:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771643520 00000100:00100000:2.0:1789127473.090286:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771643520 00000100:00100000:2.0:1789127473.090365:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:2.0:1789127473.090374:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771643520:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1789127473.090392:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127473.090412:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e087 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe02 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127473.090454:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127473.090473:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=434s v=(0 0) 00010000:00010000:2.0:1789127473.090477:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127473.090486:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e087 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe02 expref: 6 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.090506:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e087 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe02 expref: 6 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.090551:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6e00, rc 0) 00000100:00100000:2.0:1789127473.090597:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2399:x1876035771643520:12345-192.168.206.48@tcp:101:bash.0 Request processed in 224us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.090604:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00080000:3.0:1789127473.091626:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127473.095420:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127473.095587:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771643648 00000100:00100000:2.0:1789127473.095597:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771643648 00000100:00100000:2.0:1789127473.095653:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:2.0:1789127473.095664:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:12490:x1876035771643648:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1789127473.095680:0:10363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127473.095696:0:10363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe09 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.095724:0:10363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e087 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe02 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.095764:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127473.095768:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127473.095774:0:10363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 7 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.095806:0:10363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e087 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe02 expref: 7 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.095820:0:10363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e087 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe02 expref: 7 pid: 8438 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127473.095833:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10363:1876035789544192:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127473.095928:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789127473.101891:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127473.102241:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:10363:1876035789544192:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127473.102273:0:10363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 7 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.102304:0:10363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7a00, rc 0) 00000100:00100000:2.0:1789127473.102375:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:12490:x1876035771643648:12345-192.168.206.48@tcp:101:bash.0 Request processed in 6713us (6963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.102384:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:3.0:1789127473.107928:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771643776 00000100:00100000:3.0:1789127473.107942:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771643776 00010000:00010000:2.0:1789127473.108774:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e087 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe02 expref: 7 pid: 8438 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127473.108965:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 92 00000100:00100000:2.0:1789127473.108976:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9deb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771643776:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127473.109005:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127473.109026:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e087 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe02 expref: 7 pid: 8438 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.109040:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e087 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe02 expref: 7 pid: 8438 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.109095:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e087 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe02 expref: 7 pid: 8438 timeout: 534 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.109112:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127473.109116:0:6509:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127473.109124:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 6 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.109135:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 6 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.109173:0:6509:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 6 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127473.109189:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6509:1876035789544320:192.168.206.48@tcp:105: 00000100:00100000:2.0:1789127473.109294:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0da80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127473.113028:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6509:1876035789544320:192.168.206.48@tcp:105: 00010000:00010000:2.0:1789127473.113064:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127473.113130:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9deb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771643776:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 4156us (11247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.113141:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 92 00000100:00100000:1.0:1789127473.122279:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127473.122539:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771644032 00000100:00100000:2.0:1789127473.122548:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771644032 00000100:00100000:2.0:1789127473.122659:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:2.0:1789127473.122669:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:12490:x1876035771644032:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:2.0:1789127473.122957:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:12490:x1876035771644032:12345-192.168.206.48@tcp:35:bash.0 Request processed in 289us (685us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1789127473.122965:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:1.0:1789127473.254069:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127473.254199:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771644288 00000100:00100000:0.0:1789127473.254220:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771644288 00000100:00100000:0.0:1789127473.254279:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 158 00000100:00100000:0.0:1789127473.254290:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7388b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:12500:x1876035771644288:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127473.254325:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127473.254345:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe10 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127473.254433:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1789127473.254565:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e095 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe10 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.254580:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586f6bb00) 00010000:00010000:0.0:1789127473.254582:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127473.254587:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe10 expref: 23 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.254600:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec600, rc 0) 00000100:00100000:0.0:1789127473.254658:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7388b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:12500:x1876035771644288:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 370us (597us total) trans 4294967421 rc 301/301 00000100:00100000:0.0:1789127473.254665:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 158 00000100:00100000:1.0:1789127473.258038:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127473.264975:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771644544 00000100:00100000:3.0:1789127473.264988:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771644544 00000100:00100000:0.0:1789127473.273181:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:0.0:1789127473.273196:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7389e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:12500:x1876035771644544:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1789127473.275172:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7389e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:12500:x1876035771644544:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 1971us (17133us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789127473.275184:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:1.0:1789127473.422501:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127473.422622:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771644672 00000100:00100000:3.0:1789127473.422632:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771644672 00000100:00100000:3.0:1789127473.422698:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 159 00000100:00100000:3.0:1789127473.422707:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:12506:x1876035771644672:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127473.422727:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127473.422745:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785e0a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe17 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.422827:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785e0aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.422842:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785e0aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.422853:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785e0aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127473.422894:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789127473.422898:0:9447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127473.422929:0:9447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785e0aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.422952:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1000/0xd718aadfd785e0a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe17 expref: 25 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.422968:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785e0aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe17 expref: 24 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.422976:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:3.0:1789127473.422979:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127473.422982:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93469a7a0a00, rc 0) 00000100:00100000:3.0:1789127473.423040:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b08f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:12506:x1876035771644672:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 335us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127473.423047:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 159 00000100:00100000:2.0:1789127473.427107:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127473.427265:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771644928 00000100:00100000:0.0:1789127473.427287:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771644928 00000100:00100000:0.0:1789127473.427342:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 160 00000100:00100000:0.0:1789127473.427352:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:12506:x1876035771644928:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127473.427373:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127473.427393:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e0b1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe1e expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.427648:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e0b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.427663:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.427674:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e0b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127473.427684:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789127473.427851:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e0b1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe1e expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.427868:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e0b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe1e expref: 26 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.427876:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff934586f6b400) 00010000:00010000:0.0:1789127473.427879:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127473.427883:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec400, rc 0) 00000100:00100000:0.0:1789127473.427935:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+26:12506:x1876035771644928:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 584us (837us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1789127473.427942:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 160 00000100:00100000:1.0:1789127473.436630:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127473.436671:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127473.436746:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771645312 00000100:00100000:2.0:1789127473.436755:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771645312 00000100:00100000:2.0:1789127473.436806:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 161 00000100:00100000:2.0:1789127473.436814:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+26:12506:x1876035771645312:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789127473.436834:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127473.436852:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe25 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.436935:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e0cd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.436948:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e0cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.436970:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e0cd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127473.436981:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789127473.437090:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe25 expref: 29 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.437108:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e0cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe25 expref: 28 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.437116:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff934586f6b400) 00010000:00010000:2.0:1789127473.437119:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789127473.437123:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6000, rc 0) 00000100:00100000:2.0:1789127473.437180:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b083c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:12506:x1876035771645312:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 366us (507us total) trans 4294967424 rc 0/0 00000100:00100000:2.0:1789127473.437188:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 161 00000100:00100000:3.0:1789127473.437229:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771645056 00000100:00100000:3.0:1789127473.437234:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771645056 00000100:00100000:3.0:1789127473.437286:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:3.0:1789127473.437293:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:2402:x1876035771645056:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127473.437302:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127473.437316:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e0b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe1e expref: 28 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.437326:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff934586f6b400) 00010000:00010000:3.0:1789127473.437329:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127473.437349:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:2402:x1876035771645056:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 57us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127473.437354:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:1.0:1789127473.446542:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127473.447628:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771645440 00000100:00100000:2.0:1789127473.447639:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771645440 00000100:00100000:3.0:1789127473.450451:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:3.0:1789127473.450474:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771645440:12345-192.168.206.48@tcp:1:lfs.0 00010000:00010000:3.0:1789127473.450532:0:8440:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000d60cc4/0xd718aadfd785e0db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.450551:0:8440:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 6 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.450559:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127473.450563:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127473.450567:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000d60cc4/0xd718aadfd785e0db lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.450600:0:8440:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 6 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.450632:0:8440:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 6 pid: 10363 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127473.450647:0:8440:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690406d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8440:1876035789544448:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127473.450741:0:8440:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684afdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127473.456404:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127473.456549:0:8440:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690406d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8440:1876035789544448:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127473.456580:0:8440:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000000d60cc4/0xd718aadfd785e0db lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127473.456721:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771645568 00000100:00100000:2.0:1789127473.456728:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771645568 00002000:00100000:2.0:1789127473.456783:0:8443:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9346b7e86940 x1876035771645568/t0(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:209/0 lens 504/0 e 0 to 0 dl 1789127484 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789127473.456793:0:8443:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9346b7e86940 with x1876035771645568 ext(0->12) 00010000:00010000:2.0:1789127473.456800:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 7 pid: 10363 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.456814:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 7 pid: 10363 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127473.456833:0:8443:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9346b7e86940 00000100:00100000:2.0:1789127473.456869:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:2.0:1789127473.456879:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771645568:12345-192.168.206.48@tcp:4:lfs.0 00000100:00100000:2.0:1789127473.459319:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e86940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2401:x1876035771645568:12345-192.168.206.48@tcp:4:lfs.0 Request processed in 2432us (2915us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789127473.459332:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00002000:00100000:2.0:1789127473.459342:0:8443:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9346b7e86940 x1876035771645568/t4294967306(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:209/0 lens 504/448 e 0 to 0 dl 1789127484 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789127473.459353:0:8443:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9346b7e86940 with x1876035771645568 ext(0->12) 00010000:00010000:2.0:1789127473.459363:0:8443:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 9 pid: 10363 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.459381:0:8443:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 9 pid: 10363 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127473.459389:0:8443:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9346b7e86940 00000100:00100000:0.0:1789127473.464592:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127473.464613:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789544576:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127473.464681:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127473.464972:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789544576 00000100:00100000:1.0:1789127473.464980:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789544576 00000100:00100000:1.0:1789127473.465031:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789127473.465040:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789544576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127473.465070:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789127473.465335:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789544576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 296us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127473.465358:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789127473.467093:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127473.467400:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771645696 00000100:00100000:3.0:1789127473.467410:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771645696 00010000:00010000:3.0:1789127473.467447:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 9 pid: 10363 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127473.467491:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 93 00000100:00100000:3.0:1789127473.467500:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692956580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2400:x1876035771645696:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127473.467549:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789127473.467566:0:6507:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789127473.467569:0:6507:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789127472 00002000:00010000:3.0:1789127473.467572:0:6507:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789127472 00002000:00010000:3.0:1789127473.467574:0:6507:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789127472 00002000:00010000:3.0:1789127473.467576:0:6507:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1789127473.467582:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 9 pid: 10363 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.467615:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 9 pid: 10363 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.467645:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000027d6cc1/0xd718aadfd785e08e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe09 expref: 9 pid: 10363 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.467662:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127473.467666:0:6507:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127473.467671:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000000d60cc4/0xd718aadfd785e0db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.467680:0:6507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000d60cc4/0xd718aadfd785e0db lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.467704:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127473.467749:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692956580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2400:x1876035771645696:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 250us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127473.467756:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 93 00010000:00010000:1.0:1789127473.468001:0:8440:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000000d60cc4/0xd718aadfd785e0db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.468011:0:8440:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000d60cc4/0xd718aadfd785e0db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.468030:0:8440:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000d60cc4/0xd718aadfd785e0db lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.468037:0:8440:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000d60cc4/0xd718aadfd785e0db lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.468045:0:8440:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000d60cc4/0xd718aadfd785e0db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.468053:0:8440:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1000 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127473.468056:0:8440:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000d60cc4/0xd718aadfd785e0db lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.468064:0:8440:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000d60cc4/0xd718aadfd785e0db lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.468085:0:8440:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000d60cc4/0xd718aadfd785e0db lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.468109:0:8440:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000d60cc4/0xd718aadfd785e0db lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127473.468173:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771645440:12345-192.168.206.48@tcp:1:lfs.0 Request processed in 17702us (21668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127473.468181:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:0.0:1789127473.474174:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789544576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127473.476294:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127473.476381:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771645952 00000100:00100000:2.0:1789127473.476390:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771645952 00000100:00100000:2.0:1789127473.476443:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:2.0:1789127473.476453:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1bab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12506:x1876035771645952:12345-192.168.206.48@tcp:35:lfs.0 00000004:00010000:2.0:1789127473.476549:0:6526:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e0cd lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe25 expref: 27 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789127473.476714:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1789127473.476740:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1789127473.477314:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:2.0:1789127473.477354:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.477368:0:6526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785e079 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdfb expref: 31 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.477377:0:6526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.477752:0:6526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785e079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdfb expref: 31 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.477765:0:6526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785e079 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdfb expref: 31 pid: 9447 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127473.477778:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1876035789544704:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127473.477944:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346852b3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127473.483231:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127473.483335:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6526:1876035789544704:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127473.483362:0:6526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127473.483426:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771646080 00000100:00100000:3.0:1789127473.483433:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771646080 00010000:00010000:3.0:1789127473.483468:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785e079 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdfb expref: 32 pid: 9447 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127473.483545:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 94 00000100:00100000:3.0:1789127473.483555:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+32:2402:x1876035771646080:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127473.483585:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127473.483592:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785e079 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdfb expref: 32 pid: 9447 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.483603:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785e079 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdfb expref: 32 pid: 9447 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.483623:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1c00/0xd718aadfd785e079 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdfb expref: 32 pid: 9447 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.483638:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff934586f6b400) 00010000:00010000:3.0:1789127473.483642:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.483651:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.483658:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127473.483686:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127473.483732:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+31:2402:x1876035771646080:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 178us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127473.483739:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 94 00010000:00010000:1.0:1789127473.483791:0:6526:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.483799:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789127473.483899:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1789127473.484015:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1789127473.484100:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1876035789544832:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789127473.484151:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127473.484182:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dd2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127473.484829:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789544832 00000100:00100000:3.0:1789127473.484837:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789544832 00000100:00100000:3.0:1789127473.484890:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789127473.484898:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6526:x1876035789544832:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789127473.484988:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587f0b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6526:x1876035789544832:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 91us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127473.485005:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789127473.485182:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1876035789544832:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789127473.485297:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1789127473.485346:0:6526:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1876035789544960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789127473.485385:0:6526:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127473.485411:0:6526:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dd2600 going to sleep for 11 seconds 00000100:00080000:0.0:1789127473.485463:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127473.485925:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789544960 00000100:00100000:3.0:1789127473.485930:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789544960 00000100:00100000:3.0:1789127473.485962:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789127473.485970:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587895e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6526:x1876035789544960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789127473.486097:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587895e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6526:x1876035789544960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 128us (711us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789127473.486104:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789127473.486262:0:6526:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fb8780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6526:1876035789544960:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789127473.486308:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1789127473.486339:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.486350:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.486357:0:6526:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.486364:0:6526:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127473.486368:0:6526:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.486375:0:6526:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.486389:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff934586f6b400) 00010000:00010000:1.0:1789127473.486393:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789127473.486397:0:6526:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127473.486402:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e0e2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789127473.486506:0:6526:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789127473.486591:0:6526:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1789127473.486600:0:6526:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 434679090635ns, next at 435679088601ns, rc = 0 00000001:00080000:1.0:1789127473.486617:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:1.0:1789127473.486641:0:6526:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff934586f6b400) 00010000:00010000:1.0:1789127473.486643:0:6526:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789127473.486649:0:6526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e0cd lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe25 expref: 35 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127473.486734:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1bab850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+34:12506:x1876035771645952:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 10282us (10449us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1789127473.486743:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00000020:00080000:1.0:1789127473.486747:0:6526:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789127473.490015:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127473.490220:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771646208 00000100:00100000:0.0:1789127473.490229:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771646208 00000100:00100000:0.0:1789127473.490286:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 162 00000100:00100000:0.0:1789127473.490296:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+34:12506:x1876035771646208:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127473.490319:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127473.490341:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e0e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe2c expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.490394:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e0e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe2c expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.490408:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e0e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe2c expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.490425:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:0.0:1789127473.490428:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127473.490431:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fede00, rc 0) 00000100:00100000:0.0:1789127473.490501:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+35:12506:x1876035771646208:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 207us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127473.490538:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 162 00000100:00100000:1.0:1789127473.500865:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127473.503154:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771646464 00000100:00100000:0.0:1789127473.503167:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771646464 00000100:00100000:0.0:1789127473.503244:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:0.0:1789127473.503255:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587894f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+35:12506:x1876035771646464:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1789127473.503474:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587894f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+36:12506:x1876035771646464:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 220us (2618us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789127473.503482:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:1.0:1789127473.617116:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127473.617300:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771646720 00000100:00100000:2.0:1789127473.617309:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771646720 00000100:00100000:2.0:1789127473.617369:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 163 00000100:00100000:2.0:1789127473.617379:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587896580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+36:12516:x1876035771646720:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789127473.617402:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127473.617434:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e0f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe33 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127473.617561:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789127473.617650:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e0f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe33 expref: 38 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.617663:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586f6bb00) 00010000:00010000:2.0:1789127473.617666:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127473.617672:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e0f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe33 expref: 38 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.617684:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6c00, rc 0) 00000100:00100000:2.0:1789127473.617730:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587896580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+37:12516:x1876035771646720:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 354us (622us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1789127473.617737:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 163 00000100:00100000:2.0:1789127473.630625:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127473.630812:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771646848 00000100:00100000:0.0:1789127473.630822:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771646848 00000100:00100000:0.0:1789127473.630881:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 164 00000100:00100000:0.0:1789127473.630891:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+37:12516:x1876035771646848:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:0.0:1789127473.630961:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e0fe lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.630978:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e0fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.630989:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e0fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631003:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e105 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631010:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631016:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631097:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e10c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631121:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e10c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631128:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e10c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127473.631183:0:6522:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e10c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631195:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e0fe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631201:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e0fe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631207:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e0fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631212:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fedc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127473.631216:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e0fe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631222:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e0fe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631232:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:0.0:1789127473.631235:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127473.631240:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e0fe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631245:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e0fe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631265:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e105 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631271:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e105 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631275:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631280:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127473.631283:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e105 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631288:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e105 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631296:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff934586f6b300) 00010000:00010000:0.0:1789127473.631298:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127473.631301:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e105 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631307:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e105 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631316:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e10c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631322:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e10c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631327:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e10c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631336:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127473.631339:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e10c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631345:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e10c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631353:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:0.0:1789127473.631355:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127473.631358:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e10c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.631364:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e10c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127473.631436:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+37:12516:x1876035771646848:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 545us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127473.631444:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 164 00000100:00100000:1.0:1789127473.637304:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127473.637387:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771647104 00000100:00100000:0.0:1789127473.637397:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771647104 00000100:00100000:0.0:1789127473.637452:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:0.0:1789127473.637463:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+37:12516:x1876035771647104:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:0.0:1789127473.637701:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:12516:x1876035771647104:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 238us (404us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1789127473.637708:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:1.0:1789127473.698678:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127473.698854:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771647360 00000100:00100000:2.0:1789127473.698864:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771647360 00000100:00100000:2.0:1789127473.698924:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 165 00000100:00100000:2.0:1789127473.698935:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587895a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:12519:x1876035771647360:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789127473.698959:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127473.698979:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e113 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe3a expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699049:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e11a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699064:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e11a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699100:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e11a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699112:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e121 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699119:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699125:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699225:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785e128 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699234:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785e128 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699241:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785e128 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127473.699251:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789127473.699321:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e11a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699328:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e11a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699334:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e11a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699339:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127473.699349:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e11a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699357:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e11a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699369:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:2.0:1789127473.699372:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127473.699376:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e11a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699382:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e11a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699395:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e121 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699401:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e121 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699406:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e121 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699411:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127473.699414:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e121 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699420:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e121 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699427:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff934586f6b300) 00010000:00010000:2.0:1789127473.699429:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127473.699439:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e121 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699444:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e121 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699841:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e113 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe3a expref: 41 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699860:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785e128 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe3a expref: 40 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127473.699868:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:2.0:1789127473.699871:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127473.699873:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7c00, rc 0) 00000100:00100000:2.0:1789127473.699944:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587895a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+40:12519:x1876035771647360:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1010us (1273us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1789127473.699952:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 165 00000100:00100000:2.0:1789127473.710179:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127473.720100:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771647488 00000100:00100000:0.0:1789127473.720116:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771647488 00000100:00100000:0.0:1789127473.720190:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 166 00000100:00100000:0.0:1789127473.720216:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+40:12519:x1876035771647488:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:0.0:1789127473.720277:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e136 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.720292:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.720304:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.720337:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e136 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.720344:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e136 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.720362:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e136 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.720369:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127473.720373:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e136 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.720381:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e136 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.720393:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:0.0:1789127473.720396:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127473.720400:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e136 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127473.720406:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e136 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127473.720496:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+40:12519:x1876035771647488:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 282us (10325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127473.720504:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 166 00000100:00100000:1.0:1789127473.729040:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127473.735981:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771647744 00000100:00100000:0.0:1789127473.735995:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771647744 00000100:00100000:2.0:1789127473.736291:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:2.0:1789127473.736301:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+40:12519:x1876035771647744:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1789127473.736566:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+41:12519:x1876035771647744:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 265us (7533us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789127473.736574:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:3.0:1789127473.975714:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127473.975739:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789545472:0@lo:400:kworker.0 00000100:00100000:3.0:1789127473.975811:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127473.975872:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789545088:0@lo:400:kworker.0 00000100:00100000:3.0:1789127473.975903:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127473.975931:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789545984:0@lo:400:kworker.0 00000100:00100000:3.0:1789127473.975959:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127473.975977:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789546496:0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.975981:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789545472 00000100:00100000:2.0:1789127473.975990:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789545472 00000100:00100000:2.0:1789127473.976042:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789127473.976051:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690405680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789545472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127473.976141:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789545088 00000100:00100000:1.0:1789127473.976145:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789545088 00000100:00100000:1.0:1789127473.976171:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1789127473.976177:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789545088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127473.976435:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789545600:0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.976593:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690405680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789545472:12345-0@lo:400:kworker.0 Request processed in 543us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.976600:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789127473.976644:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789545984 00000100:00100000:2.0:1789127473.976648:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789545984 00000100:00100000:2.0:1789127473.976679:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789127473.976686:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587838780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789545984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.976717:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587838780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789545984:12345-0@lo:400:kworker.0 Request processed in 33us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.976724:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1789127473.976754:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690406d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789545216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127473.976781:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127473.976800:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789545856:0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.976822:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127473.976839:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789546368:0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.976861:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127473.976877:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587fb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789546880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127473.976900:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127473.976921:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1789127473.976927:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789545344:0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.976949:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127473.976964:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789545728:0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.976983:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127473.976996:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789546240:0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.977045:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127473.977333:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789546752:0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.977363:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127473.977400:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789546880 00000100:00100000:2.0:1789127473.977404:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789546880 00000100:00100000:2.0:1789127473.977439:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789127473.977446:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789546880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127473.977462:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127473.977497:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789546880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.977504:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789127473.977543:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789545856 00000100:00100000:2.0:1789127473.977546:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789545856 00000100:00100000:2.0:1789127473.977565:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789546368 00000100:00100000:2.0:1789127473.977567:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789546368 00000100:00100000:2.0:1789127473.977579:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789545344 00000100:00100000:2.0:1789127473.977581:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789545344 00000100:00100000:2.0:1789127473.977593:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789127473.977599:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789545856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.977630:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789545856:12345-0@lo:400:kworker.0 Request processed in 31us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.977636:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1789127473.977647:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789127473.977653:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789546368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.977679:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789546368:12345-0@lo:400:kworker.0 Request processed in 27us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.977685:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789127473.977704:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789127473.977709:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468528da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789545344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.977890:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468528da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3653:x1876035789545344:12345-0@lo:400:kworker.0 Request processed in 180us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.977897:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789127473.977934:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e73840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3653:1876035789545344:0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.977946:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789545856:0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.977956:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789546368:0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.977970:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587fb3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789546880:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127473.978000:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789545216 00000100:00100000:2.0:1789127473.978003:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789545216 00000100:00100000:2.0:1789127473.978288:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789545728 00000100:00100000:2.0:1789127473.978293:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789545728 00000100:00100000:2.0:1789127473.978307:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789127473.978313:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789545216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789127473.978336:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789127473.978380:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789545216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (1597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.978386:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789127473.978398:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789127473.978403:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458876b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789545728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.978430:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458876b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789545728:12345-0@lo:400:kworker.0 Request processed in 27us (1446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.978436:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789127473.978461:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789545728:0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.978486:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690406d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789545216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127473.978663:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789546240 00000100:00100000:2.0:1789127473.978667:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789546240 00000100:00100000:2.0:1789127473.978698:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789546752 00000100:00100000:2.0:1789127473.978701:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789546752 00000100:00100000:2.0:1789127473.978720:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789127473.978726:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588769e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789546240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.978782:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588769e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789546240:12345-0@lo:400:kworker.0 Request processed in 55us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.978788:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789127473.978799:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789127473.978805:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588769680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789546752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.978832:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588769680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789546752:12345-0@lo:400:kworker.0 Request processed in 28us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.978838:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789127473.978866:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789546240:0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.978878:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789546752:0@lo:400:kworker.0 00000100:00080000:2.0:1789127473.978919:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127473.978923:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127473.978926:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127473.978928:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127473.980238:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789545088:12345-0@lo:400:kworker.0 Request processed in 4056us (4330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127473.980673:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:0.0:1789127473.986747:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127473.986799:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789546112:0@lo:400:kworker.0 00000100:00100000:0.0:1789127473.986855:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127473.986871:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789546624:0@lo:400:kworker.0 00000100:00100000:0.0:1789127473.986892:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127473.986921:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127473.986927:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789547008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127473.986950:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127473.986982:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789547008 00000100:00100000:0.0:1789127473.986989:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789547008 00000100:00100000:2.0:1789127473.987398:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789545600 00000100:00100000:2.0:1789127473.987404:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789545600 00000100:00100000:2.0:1789127473.987441:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789127473.987449:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789545600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.987504:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e85e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789545600:12345-0@lo:400:kworker.0 Request processed in 57us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.987545:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1789127473.987586:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789546112 00000100:00100000:2.0:1789127473.987590:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789546112 00000100:00100000:2.0:1789127473.987621:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789546624 00000100:00100000:2.0:1789127473.987625:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789546624 00000100:00100000:2.0:1789127473.987641:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789127473.987647:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789546112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.987681:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789546112:12345-0@lo:400:kworker.0 Request processed in 34us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.987687:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789127473.987698:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789127473.987703:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789546624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.987744:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789546624:12345-0@lo:400:kworker.0 Request processed in 26us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.987750:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:2.0:1789127473.987766:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127473.987974:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789545600:0@lo:400:kworker.0 00000100:00100000:1.0:1789127473.987987:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789546112:0@lo:400:kworker.0 00000100:00100000:1.0:1789127473.987996:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789546624:0@lo:400:kworker.0 00000100:00100000:0.0:1789127473.988423:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789127473.988434:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789547008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127473.988452:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127473.988494:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789547008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (1542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127473.988499:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789127473.989886:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7f9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789547008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127473.993771:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127473.993857:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789545472:0@lo:400:kworker.0 00000100:00100000:3.0:1789127473.993868:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e71a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789545088:0@lo:400:kworker.0 00010000:00080000:3.0:1789127473.993902:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebe940 x1876035789545984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127473.993912:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789545984:0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.994014:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789546496 00000100:00100000:2.0:1789127473.994021:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789546496 00000100:00100000:2.0:1789127473.994090:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789127473.994099:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789546496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127473.994172:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789546496:12345-0@lo:400:kworker.0 Request processed in 75us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127473.994179:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00010000:00080000:1.0:1789127473.994358:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7397480 x1876035789546496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127473.994369:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789546496:0@lo:400:kworker.0 00000100:00080000:0.0:1789127473.994431:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789127474.103904:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127474.117583:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127474.117685:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771648000 00000100:00100000:2.0:1789127474.117694:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771648000 00000100:00100000:2.0:1789127474.117769:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 167 00000100:00100000:2.0:1789127474.117779:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587fb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+41:12550:x1876035771648000:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:2.0:1789127474.117815:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127474.117834:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e13d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe41 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.117924:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e144 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.117937:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.117948:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e144 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127474.117958:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789127474.118238:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e13d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe41 expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789127474.118344:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789127474.118383:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e144 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe41 expref: 43 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.118391:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:2.0:1789127474.118395:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127474.118398:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6200, rc 0) 00000100:00100000:2.0:1789127474.118499:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587fb3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+43:12550:x1876035771648000:12345-192.168.206.48@tcp:101:cat.0 Request processed in 721us (926us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1789127474.118548:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 167 00000100:00100000:0.0:1789127474.139102:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127474.139181:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127474.139255:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771648256 00000100:00100000:2.0:1789127474.139264:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771648256 00000100:00100000:2.0:1789127474.139319:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:2.0:1789127474.139335:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+43:12550:x1876035771648256:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:2.0:1789127474.139585:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+44:12550:x1876035771648256:12345-192.168.206.48@tcp:35:cat.0 Request processed in 251us (490us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789127474.139593:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:3.0:1789127474.139670:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771648384 00000100:00100000:3.0:1789127474.139680:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771648384 00000100:00100000:3.0:1789127474.139722:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:3.0:1789127474.139730:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+44:2399:x1876035771648384:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127474.139740:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127474.139762:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e144 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe41 expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.139778:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127474.139783:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127474.139804:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebe940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+43:2399:x1876035771648384:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 76us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127474.139811:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1789127474.254892:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127474.255008:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771648640 00000100:00100000:2.0:1789127474.255018:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771648640 00000100:00100000:2.0:1789127474.255095:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 168 00000100:00100000:2.0:1789127474.255105:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+43:12556:x1876035771648640:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:2.0:1789127474.255125:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127474.255129:0:9447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789127474.255153:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a0a00/0xd718aadfd785e0aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe17 expref: 43 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.255171:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:2.0:1789127474.255176:0:9447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127474.255188:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e152 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe48 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.255293:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.255308:0:9447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785e128 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe3a expref: 43 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.255315:0:9447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.255345:0:9447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785e128 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe3a expref: 43 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.255371:0:9447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785e128 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe3a expref: 43 pid: 9447 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127474.255384:0:9447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9447:1876035789547136:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127474.255769:0:9447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346852b3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127474.259596:0:9447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a0b40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9447:1876035789547136:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127474.259625:0:9447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127474.265983:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127474.266148:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771648768 00000100:00100000:3.0:1789127474.266158:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771648768 00010000:00010000:3.0:1789127474.266197:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785e128 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe3a expref: 44 pid: 9447 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127474.266239:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 95 00000100:00100000:3.0:1789127474.266249:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7389e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+44:2402:x1876035771648768:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127474.266278:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127474.266286:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785e128 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe3a expref: 44 pid: 9447 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.266300:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785e128 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe3a expref: 44 pid: 9447 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.266322:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7c00/0xd718aadfd785e128 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe3a expref: 44 pid: 9447 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.266354:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127474.266360:0:9539:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.266369:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.266376:0:9539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.266411:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127474.266755:0:9447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.266763:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127474.266781:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789127474.266896:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e152 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe48 expref: 45 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.266912:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe48 expref: 44 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.266920:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:0.0:1789127474.266923:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789127474.266925:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6600, rc 0) 00000100:00100000:3.0:1789127474.267187:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7389e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+44:2402:x1876035771648768:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 938us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127474.267197:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 95 00000100:00100000:0.0:1789127474.271878:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+43:12556:x1876035771648640:12345-192.168.206.48@tcp:101:dd.0 Request processed in 16764us (16983us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789127474.271891:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 168 00000100:00100000:0.0:1789127474.274975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127474.276237:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771648896 00000100:00100000:2.0:1789127474.276247:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771648896 00000100:00100000:2.0:1789127474.276312:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 169 00000100:00100000:2.0:1789127474.276321:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+43:12556:x1876035771648896:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:2.0:1789127474.276342:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127474.276359:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e167 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe4f expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.276390:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e16e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.276403:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e16e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.276413:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e16e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.276942:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e167 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe4f expref: 45 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.276966:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e16e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe4f expref: 44 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127474.276974:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:2.0:1789127474.276977:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789127474.276980:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6e00, rc 0) 00000100:00100000:2.0:1789127474.277043:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+44:12556:x1876035771648896:12345-192.168.206.48@tcp:101:dd.0 Request processed in 723us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127474.277050:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 169 00000100:00100000:2.0:1789127474.282058:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127474.282303:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771649152 00000100:00100000:3.0:1789127474.282313:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771649152 00000100:00100000:3.0:1789127474.282360:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 170 00000100:00100000:3.0:1789127474.282370:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+44:12556:x1876035771649152:12345-192.168.206.48@tcp:36:dd.0 00010000:00010000:3.0:1789127474.282614:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e175 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.282632:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e175 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.282643:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e175 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127474.282682:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1789127474.282705:0:6522:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a156fdbc reply state 000000007d4a283a transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e175 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.282730:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e175 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.282738:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127474.282741:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127474.282745:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127474.282838:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+47:12556:x1876035771649152:12345-192.168.206.48@tcp:36:dd.0 Request processed in 468us (786us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1789127474.282845:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 170 00000020:00080000:3.0:1789127474.282850:0:6522:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789127474.488354:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789547264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127474.488441:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127474.489017:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127474.489030:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789547392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789127474.489330:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127474.489487:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789547264 00000100:00100000:2.0:1789127474.489495:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789547264 00000100:00100000:2.0:1789127474.489558:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789547392 00000100:00100000:2.0:1789127474.489638:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789547392 00000100:00100000:2.0:1789127474.489660:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789127474.489667:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789547264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789127474.489695:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789127474.489741:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789547264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127474.490522:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789127474.490534:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789547392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127474.490547:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789127474.490839:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789547264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789127474.492470:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d292c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789547392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1927us (3126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127474.492481:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789127474.494115:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789547392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127474.501949:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789127474.668938:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127474.671251:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771649280 00000100:00100000:3.0:1789127474.671264:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771649280 00000100:00100000:3.0:1789127474.671352:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 171 00000100:00100000:3.0:1789127474.671363:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+47:12570:x1876035771649280:12345-192.168.206.48@tcp:101:stat.0 00010000:00010000:3.0:1789127474.671386:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127474.671408:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785e17c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe56 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.671479:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e183 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.671493:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e183 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.671503:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e183 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.671547:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e18a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.671573:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e18a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.671580:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e18a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.671653:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e191 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.671663:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe48 expref: 48 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.671671:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e191 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.671700:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe48 expref: 48 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.671712:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe48 expref: 48 pid: 9447 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127474.671724:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7e8b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789547520:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127474.671835:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684afdc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789127474.676984:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127474.677097:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771649536 00000100:00100000:2.0:1789127474.677106:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771649536 00000100:00100000:2.0:1789127474.677162:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:2.0:1789127474.677172:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+49:6640:x1876035771649536:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789127474.677455:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+50:6640:x1876035771649536:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 284us (492us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1789127474.677482:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:3.0:1789127474.682152:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7e8b0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789547520:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127474.682181:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e191 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127474.682471:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127474.682655:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771649664 00000100:00100000:3.0:1789127474.682674:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771649664 00010000:00010000:3.0:1789127474.682710:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe48 expref: 50 pid: 9447 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127474.682751:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 96 00000100:00100000:3.0:1789127474.682760:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d15680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+50:2402:x1876035771649664:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127474.682773:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127474.682780:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe48 expref: 50 pid: 9447 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.682792:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe48 expref: 50 pid: 9447 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.682811:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e159 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe48 expref: 50 pid: 9447 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.682826:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127474.682831:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e191 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.682840:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.682847:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e191 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.682881:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127474.682937:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d15680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+49:2402:x1876035771649664:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 177us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127474.682953:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 96 00010000:00010000:0.0:1789127474.684263:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684288:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127474.684356:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789127474.684360:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127474.684384:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684399:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e191 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684409:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e183 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684760:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e183 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684770:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e183 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684776:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501ae00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127474.684780:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e183 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684788:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e183 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684801:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:0.0:1789127474.684804:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127474.684809:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e183 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684826:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e183 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684841:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e18a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684847:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e18a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684852:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e18a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684857:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127474.684860:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e18a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684865:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e18a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684873:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff934586f6b300) 00010000:00010000:0.0:1789127474.684875:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127474.684878:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e18a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684884:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e18a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684922:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785e17c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe56 expref: 49 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684937:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e191 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe56 expref: 48 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127474.684951:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:0.0:1789127474.684953:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127474.684956:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b000, rc 0) 00000100:00100000:0.0:1789127474.685280:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d2a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+48:12570:x1876035771649280:12345-192.168.206.48@tcp:101:stat.0 Request processed in 13917us (16348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127474.685289:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 171 00000100:00100000:0.0:1789127474.822761:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127474.822964:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771649920 00000100:00100000:3.0:1789127474.822974:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771649920 00000100:00100000:3.0:1789127474.823042:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 172 00000100:00100000:3.0:1789127474.823052:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+48:12576:x1876035771649920:12345-192.168.206.48@tcp:36:truncate.0 00010000:00010000:3.0:1789127474.823125:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127474.823152:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e191 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe56 expref: 48 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.823171:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127474.823176:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127474.823338:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e198 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.823365:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.823376:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127474.823419:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1789127474.823441:0:6522:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000023515e38 reply state 00000000fd776d12 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e198 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.823454:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e198 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127474.823461:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127474.823464:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127474.823479:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127474.823632:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d16d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+50:12576:x1876035771649920:12345-192.168.206.48@tcp:36:truncate.0 Request processed in 581us (880us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1789127474.823639:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 172 00000020:00080000:3.0:1789127474.823644:0:6522:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789127475.055312:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127475.055414:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771650048 00000100:00100000:2.0:1789127475.055425:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771650048 00000100:00100000:2.0:1789127475.055490:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 173 00000100:00100000:2.0:1789127475.055500:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+50:12591:x1876035771650048:12345-192.168.206.48@tcp:101:stat.0 00010000:00010000:2.0:1789127475.055551:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127475.055571:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e19f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe5d expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055658:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e1a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055672:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e1a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055683:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e1a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055694:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e1ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055701:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e1ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055708:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e1ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055788:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e1b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055808:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055815:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127475.055854:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1789127475.055858:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127475.055877:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055888:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e1b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055897:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e1a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055903:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e1a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055909:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e1a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055915:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127475.055919:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e1a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055926:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e1a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055938:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:2.0:1789127475.055946:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127475.055952:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e1a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055959:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e1a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055978:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e1ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055984:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e1ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055990:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e1ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.055995:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7a00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127475.055997:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e1ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.056003:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e1ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.056011:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff934586f6b300) 00010000:00010000:2.0:1789127475.056013:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127475.056016:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e1ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.056022:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7a00/0xd718aadfd785e1ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.056046:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e19f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe5d expref: 52 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.057299:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe5d expref: 51 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.057313:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:2.0:1789127475.057315:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127475.057319:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6c00, rc 0) 00000100:00100000:2.0:1789127475.057385:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d2b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+51:12591:x1876035771650048:12345-192.168.206.48@tcp:101:stat.0 Request processed in 1886us (2080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127475.057394:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 173 00010000:00010000:1.0:1789127475.129047:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127475.153184:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127475.161219:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771650304 00000100:00100000:3.0:1789127475.161234:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771650304 00000100:00100000:3.0:1789127475.161388:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 174 00000100:00100000:3.0:1789127475.161399:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+51:12601:x1876035771650304:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127475.161420:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127475.161441:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe64 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127475.161567:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789127475.161661:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe64 expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.161675:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586f6bb00) 00010000:00010000:3.0:1789127475.161678:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127475.161682:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe64 expref: 53 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.161695:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b000, rc 0) 00000100:00100000:3.0:1789127475.161750:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+52:12601:x1876035771650304:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 353us (8574us total) trans 4294967447 rc 301/301 00000100:00100000:3.0:1789127475.161757:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 174 00000100:00100000:2.0:1789127475.189415:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127475.192498:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771650560 00000100:00100000:3.0:1789127475.192588:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771650560 00000100:00100000:3.0:1789127475.192726:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:3.0:1789127475.192737:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1babc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+52:12601:x1876035771650560:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1789127475.194347:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1babc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+53:12601:x1876035771650560:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 1603us (4932us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789127475.194359:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:1.0:1789127475.261157:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127475.269455:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771650816 00000100:00100000:0.0:1789127475.269472:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771650816 00000100:00100000:1.0:1789127475.273244:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 175 00000100:00100000:1.0:1789127475.273259:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+53:12607:x1876035771650816:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1789127475.273284:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127475.273305:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e1c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe6b expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.273420:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.273434:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e1b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe5d expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.273443:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.273477:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e1b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe5d expref: 54 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.273490:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e1b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe5d expref: 54 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127475.273504:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588d283c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789547648:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789127475.273630:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586dd2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127475.287860:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127475.288020:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771650944 00000100:00100000:3.0:1789127475.288028:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771650944 00010000:00010000:3.0:1789127475.288085:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e1b4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe5d expref: 55 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127475.288126:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 97 00000100:00100000:3.0:1789127475.288136:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+55:2401:x1876035771650944:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127475.288150:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127475.288157:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e1b4 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe5d expref: 55 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.288172:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e1b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe5d expref: 55 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.288194:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127475.288200:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.288211:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.288221:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.288236:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6c00/0xd718aadfd785e1b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe5d expref: 55 pid: 6523 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127475.288264:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588d283c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789547648:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127475.288266:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127475.288286:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.288296:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.288313:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127475.288331:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000100:00100000:3.0:1789127475.288334:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+54:2401:x1876035771650944:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 198us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127475.288343:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 97 00010000:00010000:1.0:1789127475.288463:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e1c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe6b expref: 55 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.288479:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe6b expref: 54 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.288486:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:1.0:1789127475.288489:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789127475.288492:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858d600, rc 0) 00000100:00100000:1.0:1789127475.288561:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d29e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+54:12607:x1876035771650816:12345-192.168.206.48@tcp:101:bash.0 Request processed in 15306us (27412us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1789127475.288569:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 175 00000001:00080000:2.0:1789127475.292716:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967449 is committed 00000004:00080000:2.0:1789127475.292755:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789127475.292774:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff934586dd2d80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789127475.292778:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9346aecaf000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff934586dd29c0 00000020:00080000:2.0:1789127475.292781:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9346aecaf900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff934587878400 00000020:00080000:0.0:1789127475.292976:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:0.0:1789127475.293036:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1789127475.294845:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e02c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.294861:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e02c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.294876:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e02c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.294882:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fecc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127475.294886:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e02c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.294893:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e02c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.294910:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9346a69cbe00) 00010000:00010000:3.0:1789127475.294913:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127475.294918:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e02c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.294926:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e02c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.294949:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e033 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.294984:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e033 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.294990:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e033 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.294996:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127475.295000:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e033 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295006:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e033 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295015:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:3.0:1789127475.295018:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127475.295021:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e033 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295026:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e033 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295042:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785e072 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295048:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785e072 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295053:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785e072 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295058:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127475.295078:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785e072 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295085:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785e072 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295093:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff934586f6b300) 00010000:00010000:3.0:1789127475.295095:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127475.295098:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785e072 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295104:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785e072 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295121:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e175 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295127:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e175 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295134:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e175 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295139:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127475.295142:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e175 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295148:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e175 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295156:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127475.295159:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127475.295168:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e175 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295174:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785e175 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295186:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e198 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295192:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e198 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295197:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e198 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295203:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127475.295207:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e198 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295212:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e198 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295220:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127475.295223:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127475.295225:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e198 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.295230:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e198 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127475.295487:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127475.295694:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127475.295711:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588d283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789547776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789127475.295763:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127475.295942:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789547776 00000100:00100000:1.0:1789127475.295950:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789547776 00000100:00100000:1.0:1789127475.296013:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789127475.296023:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3652:x1876035789547776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789127475.296045:0:8439:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:1.0:1789127475.296082:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3eb30, atime: 0x6aa3eb30, ctime: 0x6aa3eb30, blocks: 0x8 00010000:00010000:1.0:1789127475.296090:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785e1de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.296105:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=436s v=(0 0) 00010000:00010000:1.0:1789127475.296117:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127475.296125:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785e1de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.296141:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785e1de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.296150:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785e1de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.296158:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785e1de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.296174:0:8439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789127475.296312:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d14f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1876035789547776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 290us (547us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789127475.296320:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789127475.296452:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771651200 00000100:00100000:3.0:1789127475.296457:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771651200 00000100:00100000:3.0:1789127475.296498:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 176 00000100:00100000:3.0:1789127475.296533:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690406d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+17:12607:x1876035771651200:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:3.0:1789127475.296707:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1e5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.296719:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.296727:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127475.296765:0:9447:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:3.0:1789127475.296788:0:9447:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001704a8a6 reply state 0000000018a02554 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1e5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.296799:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.296805:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127475.296808:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127475.296810:0:9447:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127475.297141:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690406d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:12607:x1876035771651200:12345-192.168.206.48@tcp:36:bash.0 Request processed in 609us (1657us total) trans 4294967451 rc 0/0 00000100:00100000:3.0:1789127475.297148:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 176 00000020:00080000:3.0:1789127475.297152:0:9447:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1789127475.297221:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789127475.297232:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127475.297239:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785e1de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.297248:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858da00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127475.297253:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785e1de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.297262:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785e1de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.297291:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785e1de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.297298:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785e1de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.297317:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127475.297319:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127475.297321:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789127475.297353:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff934588d283c0/2, rc 0, transno 4294967308 00000100:00100000:0.0:1789127475.297360:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588d283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789547776:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789127475.308770:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127475.310211:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771651328 00000100:00100000:2.0:1789127475.310223:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771651328 00000100:00100000:2.0:1789127475.310288:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 177 00000100:00100000:2.0:1789127475.310299:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:12607:x1876035771651328:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1789127475.310323:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127475.310343:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e1ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe72 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.310444:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e1f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.310459:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe6b expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.310468:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e1f3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.310501:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe6b expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127475.310556:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe6b expref: 21 pid: 6524 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127475.310571:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789547904:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127475.310654:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346852b3180 going to sleep for 11 seconds 00000100:00100000:2.0:1789127475.315151:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127475.315252:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771651456 00000100:00100000:3.0:1789127475.315265:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771651456 00010000:00010000:3.0:1789127475.315305:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe6b expref: 22 pid: 6524 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127475.315327:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789547904:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127475.315349:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 98 00010000:00010000:0.0:1789127475.315354:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e1f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127475.315362:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:2401:x1876035771651456:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127475.315390:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127475.315398:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe6b expref: 22 pid: 6524 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.315412:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe6b expref: 22 pid: 6524 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.315432:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e1d0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe6b expref: 22 pid: 6524 timeout: 536 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.315447:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127475.315452:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e1f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.315463:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.315472:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e1f3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.315502:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127475.315556:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.315566:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127475.315608:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:2401:x1876035771651456:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 249us (464us total) trans 0 rc 0/0 00000004:00200000:0.0:1789127475.315613:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000100:00100000:3.0:1789127475.315619:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 98 00000004:00200000:0.0:1789127475.315620:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127475.315639:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e1f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.315678:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e1ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe72 expref: 21 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.315693:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e1f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe72 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.315701:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:0.0:1789127475.315704:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127475.315706:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6600, rc 0) 00000100:00100000:0.0:1789127475.315730:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:12607:x1876035771651328:12345-192.168.206.48@tcp:101:bash.0 Request processed in 5434us (6970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127475.315737:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 177 00000100:00100000:3.0:1789127475.320337:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127475.320488:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771651712 00000100:00100000:1.0:1789127475.320498:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771651712 00000100:00100000:1.0:1789127475.320583:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:1.0:1789127475.320592:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:12607:x1876035771651712:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:1.0:1789127475.320810:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:12607:x1876035771651712:12345-192.168.206.48@tcp:35:bash.0 Request processed in 218us (482us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1789127475.320817:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:2.0:1789127475.473140:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127475.473327:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771651968 00000100:00100000:3.0:1789127475.473337:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771651968 00000100:00100000:3.0:1789127475.473403:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 178 00000100:00100000:3.0:1789127475.473413:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7396d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:12617:x1876035771651968:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127475.473448:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127475.473470:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e1fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe79 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127475.473607:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789127475.473704:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e1fa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe79 expref: 23 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.473718:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586f6bb00) 00010000:00010000:3.0:1789127475.473721:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127475.473725:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e1fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe79 expref: 23 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.473737:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b600, rc 0) 00000100:00100000:3.0:1789127475.473809:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7396d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:12617:x1876035771651968:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 397us (677us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1789127475.473816:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 178 00000100:00100000:2.0:1789127475.483056:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127475.483178:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771652096 00000100:00100000:1.0:1789127475.483190:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771652096 00000100:00100000:1.0:1789127475.483251:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 179 00000100:00100000:1.0:1789127475.483274:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:12617:x1876035771652096:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:1.0:1789127475.483349:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e208 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483363:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e208 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483374:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e208 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483388:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e20f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483396:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e20f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483401:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e20f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483468:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e216 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483477:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483483:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789127475.483555:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483568:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e208 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483580:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e208 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483586:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e208 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483592:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127475.483596:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e208 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483602:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e208 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483614:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:1.0:1789127475.483616:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127475.483620:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e208 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483626:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e208 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483638:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e20f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483643:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e20f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483648:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e20f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483653:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858de00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127475.483661:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e20f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483666:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e20f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483674:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93468b042d00) 00010000:00010000:1.0:1789127475.483676:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127475.483679:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e20f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483684:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e20f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483697:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e216 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483703:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e216 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483709:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e216 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483713:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127475.483716:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e216 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483720:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e216 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483726:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:1.0:1789127475.483728:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127475.483735:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e216 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.483740:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e216 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127475.483820:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:12617:x1876035771652096:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 548us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127475.483827:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 179 00000100:00100000:2.0:1789127475.486613:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127475.486732:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771652352 00000100:00100000:1.0:1789127475.486741:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771652352 00000100:00100000:1.0:1789127475.486800:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:1.0:1789127475.486810:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:12617:x1876035771652352:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1789127475.487375:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:12617:x1876035771652352:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 566us (770us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789127475.487384:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:2.0:1789127475.564777:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127475.565013:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771652608 00000100:00100000:3.0:1789127475.565023:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771652608 00000100:00100000:3.0:1789127475.565090:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 180 00000100:00100000:3.0:1789127475.565100:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:12620:x1876035771652608:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127475.565122:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127475.565142:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e21d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe80 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565225:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e224 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565256:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e224 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565268:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e224 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565283:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e22b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565290:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e22b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565296:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e22b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565396:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e232 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565406:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e232 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565413:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e232 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127475.565423:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789127475.565495:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e224 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565503:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e224 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565547:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e224 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565560:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501aa00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127475.565565:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e224 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565573:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e224 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565586:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:3.0:1789127475.565589:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127475.565595:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e224 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565602:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e224 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565615:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e22b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565621:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e22b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565627:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e22b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565632:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127475.565635:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e22b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565642:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e22b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565661:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff934586f6b300) 00010000:00010000:3.0:1789127475.565663:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127475.565666:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e22b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565672:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e22b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565712:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e21d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe80 expref: 26 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565725:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e232 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe80 expref: 25 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.565732:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127475.565735:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127475.565737:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b200, rc 0) 00000100:00100000:3.0:1789127475.565806:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+25:12620:x1876035771652608:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 707us (1036us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789127475.565814:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 180 00000100:00100000:2.0:1789127475.569688:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127475.570041:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771652736 00000100:00100000:3.0:1789127475.570051:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771652736 00000100:00100000:3.0:1789127475.570125:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1789127475.570135:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+25:2399:x1876035771652736:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127475.570150:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127475.570187:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e232 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe80 expref: 25 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.570221:0:9539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127475.570226:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127475.570284:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:2399:x1876035771652736:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 151us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127475.570292:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:2.0:1789127475.576124:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127475.576204:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771652864 00000100:00100000:0.0:1789127475.576213:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771652864 00000100:00100000:0.0:1789127475.576268:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 181 00000100:00100000:0.0:1789127475.576278:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:12620:x1876035771652864:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:0.0:1789127475.576346:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e240 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.576362:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.576374:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.576408:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e240 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.576433:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e240 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.576440:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e240 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.576445:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127475.576450:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e240 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.576456:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e240 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.576468:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:0.0:1789127475.576471:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127475.576476:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e240 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.576482:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e240 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127475.576632:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:12620:x1876035771652864:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 354us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127475.576640:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 181 00000100:00100000:0.0:1789127475.584472:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127475.584661:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771653120 00000100:00100000:3.0:1789127475.584670:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771653120 00000100:00100000:3.0:1789127475.584718:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:3.0:1789127475.584728:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:12620:x1876035771653120:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1789127475.585387:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d14780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+25:12620:x1876035771653120:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 657us (923us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789127475.585396:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:2.0:1789127475.837847:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127475.837935:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771653376 00000100:00100000:3.0:1789127475.837944:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771653376 00000100:00100000:3.0:1789127475.838005:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 182 00000100:00100000:3.0:1789127475.838015:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+25:12638:x1876035771653376:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:3.0:1789127475.838036:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127475.838055:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e247 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe87 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.838199:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e24e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.838213:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e24e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.838237:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e24e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127475.838248:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789127475.838345:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e247 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe87 expref: 28 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.838363:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e24e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe87 expref: 27 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127475.838371:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127475.838374:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789127475.838377:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b600, rc 0) 00000100:00100000:3.0:1789127475.838437:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12638:x1876035771653376:12345-192.168.206.48@tcp:101:cat.0 Request processed in 423us (600us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789127475.838444:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 182 00000100:00100000:2.0:1789127475.884344:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127475.884622:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771653504 00000100:00100000:0.0:1789127475.884631:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771653504 00000100:00100000:0.0:1789127475.884695:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 183 00000100:00100000:0.0:1789127475.884705:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12639:x1876035771653504:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127475.884752:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127475.884773:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e25c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe8e expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.884838:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e263 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.884866:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.884878:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127475.884925:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789127475.884928:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127475.884945:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e263 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.884969:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e25c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe8e expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.884985:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e263 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe8e expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127475.884994:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:0.0:1789127475.884997:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127475.885000:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec600, rc 0) 00000100:00100000:0.0:1789127475.885745:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:12639:x1876035771653504:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1037us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127475.885755:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 183 00000100:00100000:2.0:1789127475.891648:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127475.891735:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771653888 00000100:00100000:1.0:1789127475.891752:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771653888 00000100:00100000:1.0:1789127475.891802:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:1.0:1789127475.891811:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:12639:x1876035771653888:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1789127475.892040:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:12639:x1876035771653888:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 230us (399us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789127475.892047:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:2.0:1789127475.894805:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127475.895023:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771654016 00000100:00100000:1.0:1789127475.895031:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771654016 00000100:00100000:1.0:1789127475.895147:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:1.0:1789127475.895157:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:12639:x1876035771654016:12345-192.168.206.48@tcp:103:lfs.0 00010000:00010000:1.0:1789127475.895185:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789127475.895205:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e1f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe72 expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.895224:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b600/0xd718aadfd785e24e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe87 expref: 28 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.895236:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e0e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe2c expref: 27 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.895246:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:1.0:1789127475.895250:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127475.895295:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+26:12639:x1876035771654016:12345-192.168.206.48@tcp:103:lfs.0 Request processed in 140us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127475.895303:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:2.0:1789127475.898736:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127475.898794:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771654144 00000100:00100000:2.0:1789127475.898803:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771654144 00000100:00100000:1.0:1789127475.898960:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 184 00000100:00100000:1.0:1789127475.898973:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+26:12639:x1876035771654144:12345-192.168.206.48@tcp:58:lfs.0 00010000:00010000:1.0:1789127475.899247:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e26a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.899263:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e26a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.899275:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e26a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127475.899442:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789127475.899545:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+26:12639:x1876035771654144:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 574us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127475.899566:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 184 00000100:00100000:2.0:1789127475.936125:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127475.936247:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771654272 00000100:00100000:1.0:1789127475.936256:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771654272 00000100:00100000:1.0:1789127475.936321:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 185 00000100:00100000:1.0:1789127475.936336:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+26:12641:x1876035771654272:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1789127475.936357:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127475.936385:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e271 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe95 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936452:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e278 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936465:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936476:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936490:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e27f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936497:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936503:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936601:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e286 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936628:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936635:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127475.936674:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789127475.936678:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127475.936694:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936705:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e286 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936713:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e278 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936720:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e278 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936726:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e278 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936732:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127475.936736:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e278 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936743:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e278 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936753:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:1.0:1789127475.936756:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127475.936768:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e278 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936774:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e278 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936788:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e27f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936794:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e27f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936799:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e27f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936804:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858cc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127475.936807:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e27f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936812:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e27f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936819:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93468b042d00) 00010000:00010000:1.0:1789127475.936822:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127475.936825:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e27f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936831:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e27f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936873:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e271 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe95 expref: 28 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936911:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e286 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe95 expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127475.936919:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:1.0:1789127475.936921:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127475.936924:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c600, rc 0) 00000100:00100000:1.0:1789127475.936975:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12641:x1876035771654272:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 645us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127475.936983:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 185 00010000:00010000:1.0:1789127476.164711:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789127476.599732:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127476.599741:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127476.599782:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789127476.599788:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789127476.599992:0:14502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345887e1e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14502:1876035789548032:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789127476.600192:0:14502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346852b3180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127476.608478:0:14502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345887e1e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14502:1876035789548032:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789127476.628179:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127476.628842:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771654400 00000100:00100000:2.0:1789127476.628861:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771654400 00000100:00100000:2.0:1789127476.628935:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 186 00000100:00100000:2.0:1789127476.628946:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12652:x1876035771654400:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789127476.628977:0:9447:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789127476.629097:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d29680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12652:x1876035771654400:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 152us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127476.629105:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 186 00000100:00080000:3.0:1789127476.629760:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127476.636758:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127476.637377:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771654528 00000100:00100000:1.0:1789127476.637386:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771654528 00000100:00100000:1.0:1789127476.639461:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 187 00000100:00100000:1.0:1789127476.639490:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12652:x1876035771654528:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789127476.639582:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e28d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639597:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e28d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639609:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e28d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639625:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e294 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639640:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e294 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639648:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e294 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639674:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e29b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639681:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e29b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639687:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e29b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127476.639726:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789127476.639731:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127476.639743:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e29b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639754:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e28d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639760:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e28d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639766:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e28d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639772:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858cc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127476.639776:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e28d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639789:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e28d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639801:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4200) 00010000:00010000:1.0:1789127476.639804:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127476.639809:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e28d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639815:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e28d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639825:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e294 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639830:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e294 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639835:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e294 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639840:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127476.639842:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e294 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.639847:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e294 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.640202:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff93468b042d00) 00010000:00010000:1.0:1789127476.640205:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127476.640209:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e294 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.640225:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e294 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.640240:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e29b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.640246:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e29b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.640251:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e29b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.640256:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127476.640258:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e29b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.640264:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e29b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.640271:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:1.0:1789127476.640273:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127476.640276:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e29b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.640281:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e29b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127476.640371:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12652:x1876035771654528:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 899us (3623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127476.640380:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 187 00000100:00100000:3.0:1789127476.644503:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127476.650168:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771654784 00000100:00100000:2.0:1789127476.650182:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771654784 00000100:00100000:2.0:1789127476.650323:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 188 00000100:00100000:2.0:1789127476.650335:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692956580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12652:x1876035771654784:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127476.650354:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127476.650373:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e2a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffe9c expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.650495:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.650527:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.650539:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127476.650550:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789127476.650619:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.650626:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.650632:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.650637:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127476.650641:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.650647:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.650657:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:2.0:1789127476.650659:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127476.650664:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.650678:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.650716:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e2a2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe9c expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.650726:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4200) 00010000:00010000:2.0:1789127476.650728:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127476.650916:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e2a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe9c expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.650930:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7200, rc 0) 00000100:00100000:2.0:1789127476.650988:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692956580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:12652:x1876035771654784:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 656us (6493us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1789127476.650997:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 188 00000100:00100000:0.0:1789127476.662115:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127476.664486:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771654912 00000100:00100000:2.0:1789127476.664500:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771654912 00000100:00100000:2.0:1789127476.664583:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 189 00000100:00100000:2.0:1789127476.664594:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:12652:x1876035771654912:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789127476.664628:0:9447:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789127476.664915:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:12652:x1876035771654912:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 322us (2807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127476.664923:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 189 00000100:00100000:1.0:1789127476.673167:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127476.673243:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771655168 00000100:00100000:2.0:1789127476.673253:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771655168 00000100:00100000:2.0:1789127476.673317:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 190 00000100:00100000:2.0:1789127476.673335:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:12652:x1876035771655168:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127476.673354:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127476.673357:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789127476.673381:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e263 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe8e expref: 28 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.673397:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:2.0:1789127476.673402:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127476.673414:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e2b7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffea3 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789127476.673925:0:6523:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1789127476.674070:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.674083:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.674092:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.674142:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7200/0xd718aadfd785e2b7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffea3 expref: 30 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.674156:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffea3 expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.674164:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9346b7264200) 00010000:00010000:2.0:1789127476.674166:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127476.674177:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6800, rc 0) 00000100:00100000:2.0:1789127476.674233:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d2ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:12652:x1876035771655168:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 902us (1075us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1789127476.674241:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 190 00000100:00100000:2.0:1789127476.678040:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.678164:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771655424 00000100:00100000:3.0:1789127476.678174:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771655424 00000100:00100000:3.0:1789127476.678230:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 191 00000100:00100000:3.0:1789127476.678240:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:12652:x1876035771655424:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789127476.678292:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127476.678386:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6800/0xd718aadfd785e2be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffea3 expref: 29 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.678404:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9346b7264200) 00010000:00010000:3.0:1789127476.678429:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127476.678452:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e2cc lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.678464:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e2cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.678474:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e2cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681173:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e2d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x6763ed8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681192:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e2d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6763ed8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681202:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e2d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6763ed8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681254:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e2cc lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681260:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e2cc lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681267:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e2cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681273:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127476.681276:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e2cc lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681283:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e2cc lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681295:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:2.0:1789127476.681366:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127476.681383:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e2cc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681389:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e2cc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681402:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e2d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6763ed8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681409:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e2d3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6763ed8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681415:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e2d3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6763ed8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681420:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127476.681423:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e2d3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6763ed8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681429:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e2d3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6763ed8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681437:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x6763ed8e (ffff9346b7264100) 00010000:00010000:2.0:1789127476.681439:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127476.681441:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e2d3 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6763ed8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.681446:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e2d3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6763ed8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127476.682017:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:12652:x1876035771655424:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 3772us (3980us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127476.682027:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 191 00000100:00100000:2.0:1789127476.684605:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127476.684667:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771655552 00000100:00100000:1.0:1789127476.684675:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771655552 00000100:00100000:1.0:1789127476.684754:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 192 00000100:00100000:1.0:1789127476.684764:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345887e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:12652:x1876035771655552:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127476.684782:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127476.684803:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785e2da lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffeaa expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.684836:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e2e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.684848:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.684858:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e2e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.684960:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785e2da lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeaa expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.684976:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e2e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeaa expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.684984:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93468b042d00) 00010000:00010000:1.0:1789127476.684987:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789127476.684990:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c400, rc 0) 00000100:00100000:1.0:1789127476.685039:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345887e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:12652:x1876035771655552:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 278us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127476.685054:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 192 00000100:00100000:0.0:1789127476.691765:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127476.691872:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771655808 00000100:00100000:1.0:1789127476.691881:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771655808 00000100:00100000:1.0:1789127476.691932:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 193 00000100:00100000:1.0:1789127476.691941:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:12652:x1876035771655808:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789127476.692012:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e2e8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.692027:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.692039:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127476.692202:0:9447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1789127476.692211:0:9447:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 437884701393ns, next at 438884698930ns, rc = 0 00000004:00010000:1.0:1789127476.692256:0:9447:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000023eaa19b reply state 0000000082b3bb42 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e2e8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.692269:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e2e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.692277:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93468b042d00) 00010000:00010000:1.0:1789127476.692280:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789127476.692284:0:9447:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789127476.692387:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d14b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+31:12652:x1876035771655808:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 447us (631us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1789127476.692394:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 193 00000100:00100000:2.0:1789127476.695123:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.695185:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771655936 00000100:00100000:3.0:1789127476.695193:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771655936 00000100:00100000:3.0:1789127476.695240:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 194 00000100:00100000:3.0:1789127476.695249:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+31:12652:x1876035771655936:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127476.695269:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127476.695286:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e2ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffeb1 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.695347:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e2ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeb1 expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.695360:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e2ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeb1 expref: 32 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.695375:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93468b042d00) 00010000:00010000:3.0:1789127476.695378:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127476.695382:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b400, rc 0) 00000100:00100000:3.0:1789127476.695436:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+32:12652:x1876035771655936:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 188us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127476.695458:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 194 00000100:00100000:3.0:1789127476.698981:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127476.699126:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771656064 00000100:00100000:2.0:1789127476.699149:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771656064 00000100:00100000:2.0:1789127476.699222:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:2.0:1789127476.699233:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771656064:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789127476.699450:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771656064:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 219us (476us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789127476.699458:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00080000:3.0:1789127476.700467:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127476.703134:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127476.703237:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771656320 00000100:00100000:1.0:1789127476.703257:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771656320 00000100:00100000:1.0:1789127476.703314:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:1.0:1789127476.703325:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+32:12652:x1876035771656320:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789127476.703558:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+33:12652:x1876035771656320:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 234us (431us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1789127476.703566:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:1.0:1789127476.706403:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127476.706590:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771656576 00000100:00100000:2.0:1789127476.706599:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771656576 00000100:00100000:2.0:1789127476.706656:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 195 00000100:00100000:2.0:1789127476.706666:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+33:12652:x1876035771656576:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789127476.706778:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d28f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+33:12652:x1876035771656576:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 113us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127476.706786:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 195 00000100:00100000:2.0:1789127476.709199:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.709420:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771656704 00000100:00100000:3.0:1789127476.709429:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771656704 00000100:00100000:3.0:1789127476.709496:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 196 00000100:00100000:3.0:1789127476.709505:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+33:12652:x1876035771656704:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127476.709556:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127476.709576:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e2f6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffeb8 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.709638:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e2fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.709653:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e2fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.709665:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e2fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127476.709708:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127476.709727:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e2fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.709765:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e2f6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeb8 expref: 35 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.709782:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e2fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeb8 expref: 34 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.709960:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93468b042d00) 00010000:00010000:3.0:1789127476.709963:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789127476.709966:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501ba00, rc 0) 00000100:00100000:2.0:1789127476.710095:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+34:12652:x1876035771656704:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 590us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127476.710103:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 196 00000100:00100000:3.0:1789127476.735600:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127476.735722:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771656832 00000100:00100000:1.0:1789127476.735742:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771656832 00000100:00100000:1.0:1789127476.735805:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:1.0:1789127476.735816:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771656832:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127476.735832:0:8440:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127476.735851:0:8440:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e53e0f6/0xd718aadfd785e304 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffebf expref: -99 pid: 8440 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127476.735875:0:8440:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3eb33, blocks: 0x0 00010000:00010000:1.0:1789127476.735894:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=437s v=(0 0) 00010000:00010000:1.0:1789127476.735898:0:8440:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127476.735906:0:8440:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e53e0f6/0xd718aadfd785e304 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffebf expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.735920:0:8440:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e53e0f6/0xd718aadfd785e304 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffebf expref: 8 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.735932:0:8440:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858ce00, rc 0) 00000100:00100000:1.0:1789127476.735985:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2401:x1876035771656832:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 172us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127476.735999:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:3.0:1789127476.757365:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.757408:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.757436:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.757463:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771657216 00000100:00100000:3.0:1789127476.757472:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771657216 00000100:00100000:3.0:1789127476.757541:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 137 00000100:00100000:3.0:1789127476.757552:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7389e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2399:x1876035771657216:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127476.757619:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7389e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2399:x1876035771657216:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 69us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127476.757627:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 137 00000100:00100000:3.0:1789127476.757649:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771657472 00000100:00100000:3.0:1789127476.757653:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771657472 00000100:00100000:3.0:1789127476.757684:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 357 00000100:00100000:3.0:1789127476.757691:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771657472:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127476.757719:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771657472:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127476.757725:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 357 00000100:00080000:3.0:1789127476.757756:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789127476.757761:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127476.758537:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771656960 00000100:00100000:1.0:1789127476.758545:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771656960 00000100:00100000:1.0:1789127476.758584:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 454 00000100:00100000:1.0:1789127476.758592:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2402:x1876035771656960:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127476.758628:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2402:x1876035771656960:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 38us (1273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127476.758634:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 454 00000100:00100000:3.0:1789127476.760337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.761971:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771657088 00000100:00100000:3.0:1789127476.761988:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771657088 00000100:00100000:3.0:1789127476.762050:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 358 00000100:00100000:3.0:1789127476.762077:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345884a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771657088:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127476.762139:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345884a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771657088:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 64us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127476.762146:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 358 00000100:00080000:3.0:1789127476.762166:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127476.766214:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127476.766260:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127476.766289:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771657344 00000100:00100000:1.0:1789127476.766298:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771657344 00000100:00100000:1.0:1789127476.766559:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 359 00000100:00100000:1.0:1789127476.766571:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771657344:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127476.766634:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771657344:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 66us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127476.766642:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 359 00000100:00100000:1.0:1789127476.766659:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771657728 00000100:00100000:1.0:1789127476.766662:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771657728 00000100:00100000:1.0:1789127476.766678:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 197 00000100:00100000:1.0:1789127476.766683:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+34:12652:x1876035771657728:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789127476.767192:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d28780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+34:12652:x1876035771657728:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 50us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127476.767200:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 197 00000100:00080000:1.0:1789127476.767218:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127476.776311:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.776350:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771657856 00000100:00100000:3.0:1789127476.776359:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771657856 00000100:00100000:3.0:1789127476.776407:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:3.0:1789127476.776417:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:12652:x1876035771657856:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127476.776434:0:10363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127476.776451:0:10363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e30b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffec6 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.776479:0:10363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e53e0f6/0xd718aadfd785e304 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffebf expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.776488:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127476.776492:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127476.776498:0:10363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e30b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffec6 expref: 9 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.776548:0:10363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e53e0f6/0xd718aadfd785e304 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffebf expref: 9 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.776576:0:10363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e53e0f6/0xd718aadfd785e304 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffebf expref: 9 pid: 8440 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127476.776591:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458856c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10363:1876035789548160:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127476.776669:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684afdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127476.779129:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458856c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10363:1876035789548160:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127476.779162:0:10363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e30b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffec6 expref: 9 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.779182:0:10363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501ac00, rc 0) 00000100:00100000:3.0:1789127476.779226:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:12652:x1876035771657856:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 2810us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127476.779235:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:0.0:1789127476.798479:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.798599:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771657984 00000100:00100000:3.0:1789127476.798610:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771657984 00010000:00010000:3.0:1789127476.798649:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e53e0f6/0xd718aadfd785e304 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffebf expref: 9 pid: 8440 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127476.798695:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 99 00000100:00100000:3.0:1789127476.798705:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2402:x1876035771657984:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127476.798719:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127476.798755:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e53e0f6/0xd718aadfd785e304 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffebf expref: 9 pid: 8440 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.798781:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e53e0f6/0xd718aadfd785e304 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffebf expref: 9 pid: 8440 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.799091:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e53e0f6/0xd718aadfd785e304 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffebf expref: 9 pid: 8440 timeout: 537 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.799106:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127476.799111:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127476.799119:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e30b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffec6 expref: 8 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.799129:0:9539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e30b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffec6 expref: 8 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.799163:0:9539:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e30b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffec6 expref: 8 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127476.799177:0:9539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458856c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9539:1876035789548288:192.168.206.48@tcp:105: 00000100:00100000:3.0:1789127476.799254:0:9539:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684afdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127476.805284:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127476.806381:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771658112 00000100:00100000:1.0:1789127476.806392:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771658112 00002000:00100000:1.0:1789127476.806444:0:8445:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff934588d170c0 x1876035771658112/t0(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:212/0 lens 504/0 e 0 to 0 dl 1789127487 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789127476.806456:0:8445:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff934588d170c0 with x1876035771658112 ext(0->8) 00002000:00010000:1.0:1789127476.806462:0:8445:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff934588d170c0 00000100:00100000:1.0:1789127476.806491:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1789127476.806500:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2401:x1876035771658112:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789127476.812758:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d170c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+11:2401:x1876035771658112:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 Request processed in 6246us (7473us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789127476.812774:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00002000:00100000:2.0:1789127476.812787:0:8445:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff934588d170c0 x1876035771658112/t4294967315(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:212/0 lens 504/448 e 0 to 0 dl 1789127487 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789127476.812799:0:8445:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff934588d170c0 with x1876035771658112 ext(0->8) 00002000:00010000:2.0:1789127476.812806:0:8445:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff934588d170c0 00000100:00100000:3.0:1789127476.813080:0:9539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458856c780 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9539:1876035789548288:192.168.206.48@tcp:105: 00010000:00010000:3.0:1789127476.813099:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127476.813137:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+10:2402:x1876035771657984:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 14434us (14668us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127476.813145:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 99 00000100:00100000:1.0:1789127476.822383:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.822495:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771658240 00000100:00100000:3.0:1789127476.822504:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771658240 00000100:00100000:3.0:1789127476.822576:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 198 00000100:00100000:3.0:1789127476.822585:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+34:12652:x1876035771658240:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789127476.825047:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1789127476.825077:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1789127476.825117:0:6501:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1789127476.825260:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458856c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789548416:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789127476.825324:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127476.825464:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:12652:x1876035771658240:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 2877us (3086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127476.825475:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 198 00000100:00100000:2.0:1789127476.825611:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789548416 00000100:00100000:2.0:1789127476.825618:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789548416 00000100:00100000:2.0:1789127476.825660:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789127476.825668:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789548416:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:3.0:1789127476.825818:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1789127476.825936:0:8439:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789127476.825940:0:8439:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789127475 00002000:00010000:2.0:1789127476.825942:0:8439:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789127476.825944:0:8439:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789127475 -> 1789127475 00002000:00010000:2.0:1789127476.825946:0:8439:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789127476.825987:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789548416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 320us (663us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789127476.825994:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:3.0:1789127476.826076:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff93458856c780/2, rc 0, transno 4294967316 00000100:00100000:3.0:1789127476.826082:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458856c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789548416:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1789127476.826311:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1e5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.826322:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1e5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.826329:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.826335:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127476.826338:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1e5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.826345:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1e5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.826360:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:0.0:1789127476.826364:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127476.826369:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1e5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.826375:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e1e5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.826388:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e2e8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.826403:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e2e8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.826408:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e2e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.826413:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127476.826416:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e2e8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.826421:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e2e8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.826430:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93468b042d00) 00010000:00010000:0.0:1789127476.826432:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789127476.826435:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e2e8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.826440:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e2e8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1789127476.826458:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1789127476.826468:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789127476.836275:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.836305:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771658368 00000100:00100000:3.0:1789127476.836314:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771658368 00000100:00100000:3.0:1789127476.836359:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:3.0:1789127476.836369:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+10:2399:x1876035771658368:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789127476.840167:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:1.0:1789127476.840180:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1789127476.841334:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2399:x1876035771658368:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 4958us (5059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127476.841346:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:3.0:1789127476.848267:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.848302:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771658624 00000100:00100000:3.0:1789127476.848310:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771658624 00000100:00100000:3.0:1789127476.848352:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 199 00000100:00100000:3.0:1789127476.848360:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:12652:x1876035771658624:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789127476.848420:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127476.848443:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e2fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeb8 expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.848459:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93468b042d00) 00010000:00010000:3.0:1789127476.848463:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127476.848498:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e312 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.848528:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.848538:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127476.848642:0:6523:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000deb6b67b reply state 000000004147a4e2 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e312 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.848653:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e312 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.848660:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93468b042d00) 00010000:00010000:3.0:1789127476.848662:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127476.848665:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789127476.850893:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:12652:x1876035771658624:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 759us (858us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1789127476.850904:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 199 00000100:00100000:1.0:1789127476.851206:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127476.851259:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771658752 00000100:00100000:2.0:1789127476.851267:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771658752 00000100:00100000:2.0:1789127476.851301:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:2.0:1789127476.851308:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771658752:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789127476.851427:0:10363:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789127476.851430:0:10363:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789127475 -> 1789127474 00002000:00010000:2.0:1789127476.851432:0:10363:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789127472 00002000:00010000:2.0:1789127476.851435:0:10363:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789127475 -> 1789127474 00002000:00010000:2.0:1789127476.851437:0:10363:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789127476.851491:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d28b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2401:x1876035771658752:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 169us (272us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789127476.851497:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:0.0:1789127476.854960:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.855090:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771659008 00000100:00100000:3.0:1789127476.855099:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771659008 00000100:00100000:3.0:1789127476.855158:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 200 00000100:00100000:3.0:1789127476.855178:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:12652:x1876035771659008:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789127476.855241:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.855256:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e2e1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeaa expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.855265:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.855296:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e2e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeaa expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.855309:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e2e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeaa expref: 20 pid: 6524 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127476.855322:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789548544:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127476.855396:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684afd300 going to sleep for 11 seconds 00000100:00100000:2.0:1789127476.858002:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127476.858077:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771659136 00000100:00100000:0.0:1789127476.858085:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771659136 00010000:00010000:0.0:1789127476.858123:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e2e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeaa expref: 21 pid: 6524 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127476.858164:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 100 00000100:00100000:0.0:1789127476.858186:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:2401:x1876035771659136:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127476.858200:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127476.858207:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e2e1 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeaa expref: 21 pid: 6524 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.858219:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e2e1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeaa expref: 21 pid: 6524 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.858238:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93468b042d00) 00010000:00010000:0.0:1789127476.858244:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.858252:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.858259:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.858276:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127476.858322:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:2401:x1876035771659136:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 138us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127476.858329:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 100 00010000:00010000:3.0:1789127476.858803:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e2e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeaa expref: 20 pid: 6524 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127476.858818:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789548544:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127476.858836:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.858845:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.858863:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.858896:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.858903:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.858909:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.858915:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127476.858919:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.858926:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.858936:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93468b042d00) 00010000:00010000:3.0:1789127476.858939:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789127476.858942:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.858947:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e319 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127476.859036:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d15a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:12652:x1876035771659008:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 Request processed in 3859us (4082us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789127476.859044:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 200 00000100:00100000:2.0:1789127476.864154:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127476.864264:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771659264 00000100:00100000:1.0:1789127476.864273:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771659264 00000100:00100000:1.0:1789127476.864327:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:1.0:1789127476.864337:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2401:x1876035771659264:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789127476.864380:0:8439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785e320 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.864399:0:8439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e30b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffec6 expref: 8 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.864407:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789127476.864411:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789127476.864416:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785e320 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.864464:0:8439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e30b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffec6 expref: 8 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127476.864484:0:8439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e30b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffec6 expref: 8 pid: 10363 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127476.864499:0:8439:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588d2a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1876035789548672:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789127476.864600:0:8439:0:(client.c:2715:ptlrpc_set_wait()) set ffff9345810a19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127476.867095:0:8439:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588d2a580 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8439:1876035789548672:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127476.867123:0:8439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785e320 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127476.879906:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127476.880302:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771659392 00000100:00100000:0.0:1789127476.880312:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771659392 00010000:00010000:0.0:1789127476.880348:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e30b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffec6 expref: 9 pid: 10363 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127476.880385:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 101 00000100:00100000:0.0:1789127476.880394:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2401:x1876035771659392:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127476.880419:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127476.880440:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e30b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffec6 expref: 9 pid: 10363 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.880454:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e30b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffec6 expref: 9 pid: 10363 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.880483:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e30b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffec6 expref: 9 pid: 10363 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.880499:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127476.880503:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127476.880532:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785e320 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.880544:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785e320 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.880572:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127476.880618:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2401:x1876035771659392:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 225us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127476.880626:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 101 00010000:00010000:2.0:1789127476.887013:0:8439:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785e320 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.887034:0:8439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785e320 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.887079:0:8439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785e320 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.887087:0:8439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785e320 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.887094:0:8439:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785e320 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.887101:0:8439:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858cc00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127476.887104:0:8439:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785e320 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.887112:0:8439:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785e320 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.887130:0:8439:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785e320 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.887149:0:8439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000affd34e/0xd718aadfd785e320 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127476.887239:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771659264:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 22899us (23086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127476.887249:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:2.0:1789127476.890998:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.891079:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771659648 00000100:00100000:3.0:1789127476.891088:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771659648 00000100:00100000:3.0:1789127476.891179:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 201 00000100:00100000:3.0:1789127476.891190:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690401e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:12652:x1876035771659648:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789127476.891262:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.891279:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e16e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe4f expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.891289:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.891321:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e16e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe4f expref: 19 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.891334:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e16e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe4f expref: 19 pid: 6523 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127476.891348:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789548800:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127476.891421:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684afd300 going to sleep for 11 seconds 00000100:00100000:0.0:1789127476.909464:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127476.909493:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771659776 00000100:00100000:0.0:1789127476.909502:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771659776 00010000:00010000:0.0:1789127476.909559:0:6507:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e16e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe4f expref: 20 pid: 6523 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127476.909603:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 102 00000100:00100000:0.0:1789127476.909612:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9dea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:2402:x1876035771659776:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127476.909627:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127476.909633:0:6507:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e16e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe4f expref: 20 pid: 6523 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.909647:0:6507:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e16e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe4f expref: 20 pid: 6523 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.909667:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:0.0:1789127476.909673:0:6507:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.909682:0:6507:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.909689:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.909705:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127476.910183:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e16e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe4f expref: 20 pid: 6523 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127476.910198:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cd2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789548800:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127476.910216:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.910226:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.910232:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.910375:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.910387:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e2ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeb1 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.910396:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.910428:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e2ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeb1 expref: 20 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.910441:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e2ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeb1 expref: 20 pid: 6523 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127476.910454:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904030c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789548928:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127476.910527:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346852b3300 going to sleep for 11 seconds 00000100:00100000:0.0:1789127476.910830:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9dea450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:2402:x1876035771659776:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 1217us (1372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127476.910840:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 102 00000040:00080000:2.0:1789127476.917556:0:15411:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127476.917564:0:15411:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127476.917589:0:15411:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789127476.917595:0:15411:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789127476.923455:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127476.923502:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904030c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789548928:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127476.923547:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127476.923583:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771659904 00000100:00100000:0.0:1789127476.923588:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771659904 00010000:00010000:0.0:1789127476.923621:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e2ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeb1 expref: 20 pid: 6523 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127476.923651:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 103 00000100:00100000:0.0:1789127476.923660:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:2402:x1876035771659904:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127476.923674:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127476.923680:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e2ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeb1 expref: 20 pid: 6523 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.923693:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e2ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeb1 expref: 20 pid: 6523 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.923713:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e2ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffeb1 expref: 20 pid: 6523 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.923725:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93468b042d00) 00010000:00010000:0.0:1789127476.923740:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.923748:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.923755:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.923775:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127476.923820:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d16580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:2402:x1876035771659904:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 162us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127476.923827:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 103 00010000:00010000:0.0:1789127476.923849:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.923855:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789127476.923949:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1789127476.924049:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1789127476.924099:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1789127476.924165:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588d161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1876035789549056:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789127476.924204:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127476.924223:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346903516c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127476.924825:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789549056 00000100:00100000:2.0:1789127476.924832:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789549056 00000100:00100000:2.0:1789127476.924870:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789127476.924878:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1876035789549056:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789127476.924954:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6523:x1876035789549056:12345-0@lo:1000:mdt00_001.0 Request processed in 77us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127476.924961:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789127476.926452:0:6523:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1789127476.926462:0:6523:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff93458856c780, transno 4294967316 00000100:00100000:0.0:1789127476.926483:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588d161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1876035789549056:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789127476.926651:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1789127476.926718:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588d161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1876035789549184:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789127476.926782:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127476.926808:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff934690351d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127476.926934:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789549184 00000100:00100000:2.0:1789127476.926940:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789549184 00000100:00100000:2.0:1789127476.926988:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789127476.926997:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6523:x1876035789549184:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789127476.927131:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d16940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6523:x1876035789549184:12345-0@lo:1000:mdt00_001.0 Request processed in 135us (349us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1789127476.927139:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789127476.927182:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588d161c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1876035789549184:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789127476.927216:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927225:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927232:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927238:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127476.927242:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927249:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927263:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93468b042d00) 00010000:00010000:2.0:1789127476.927266:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789127476.927270:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927275:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6600/0xd718aadfd785e32e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927297:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e26a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927304:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e26a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927309:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e26a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927320:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127476.927323:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e26a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927330:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e26a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927338:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:2.0:1789127476.927341:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789127476.927344:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e26a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927351:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e26a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927375:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927387:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e286 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe95 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927396:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927419:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e286 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe95 expref: 22 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127476.927432:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e286 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe95 expref: 22 pid: 6524 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127476.927456:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789549312:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127476.927538:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346852b3d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127476.936417:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789549312:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127476.936444:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127476.937193:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.939503:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771660032 00000100:00100000:3.0:1789127476.939553:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771660032 00010000:00010000:3.0:1789127476.939597:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e286 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe95 expref: 23 pid: 6524 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127476.939661:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 104 00000100:00100000:3.0:1789127476.939670:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:2402:x1876035771660032:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127476.939684:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127476.939690:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e286 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe95 expref: 23 pid: 6524 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939701:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e286 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe95 expref: 23 pid: 6524 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939722:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e286 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffe95 expref: 23 pid: 6524 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939749:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127476.939755:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939765:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939771:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939799:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127476.939851:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d17c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:2402:x1876035771660032:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 181us (2661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127476.939858:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 104 00010000:00010000:3.0:1789127476.939887:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939900:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939912:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939918:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939925:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939931:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127476.939935:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939943:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939952:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127476.939954:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127476.939958:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939964:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6200/0xd718aadfd785e335 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939973:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939979:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939990:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.939995:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127476.939998:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.940004:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.940011:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cbf00) 00010000:00010000:3.0:1789127476.940013:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789127476.940016:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.940022:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e327 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127476.940166:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690401e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:12652:x1876035771659648:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 48978us (49177us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1789127476.940174:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 201 00000020:00080000:3.0:1789127476.940178:0:6523:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789127476.940841:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789127476.940847:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789127476.941366:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1789127476.941377:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789127476.953450:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127476.954621:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771660288 00000100:00100000:3.0:1789127476.954633:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771660288 00000100:00100000:3.0:1789127476.954695:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:3.0:1789127476.954705:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1ba9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:12652:x1876035771660288:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789127476.954956:0:6526:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789127476.954985:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1789127476.955025:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e33c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.955040:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e33c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.955051:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e33c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.955071:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e33c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.955078:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e33c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.955084:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e33c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127476.955104:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789127476.955182:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1ba9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:12652:x1876035771660288:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 479us (1739us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789127476.955190:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000020:00080000:3.0:1789127476.955194:0:6526:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789127476.956216:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127476.956227:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e33c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.956236:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501ba00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127476.956240:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e33c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.956260:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e33c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.956277:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93468b042d00) 00010000:00010000:0.0:1789127476.956281:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789127476.956286:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e33c lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.956302:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e33c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127476.956318:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127476.956320:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127476.956322:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127477.177429:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127478.203361:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127478.583779:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127478.583800:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588d2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789549440:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127478.583863:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127478.583921:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789549440 00000100:00100000:1.0:1789127478.583928:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789549440 00000100:00100000:1.0:1789127478.583985:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789127478.583993:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789549440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127478.584024:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789127478.584090:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d2b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789549440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127478.584098:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789127478.584142:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588d2a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789549440:0@lo:41:osp-pre-0-1.0 00000001:00080000:1.0:1789127478.596139:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1789127478.596155:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000040:00080000:0.0:1789127478.907040:0:15462:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789127478.907061:0:15462:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789127478.907086:0:15462:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789127478.907092:0:15462:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789127479.059676:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.059745:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771660544 00000100:00100000:3.0:1789127479.059754:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771660544 00000100:00100000:3.0:1789127479.059826:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 202 00000100:00100000:3.0:1789127479.059837:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:12670:x1876035771660544:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127479.059858:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127479.059877:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffecd expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.059988:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e34a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.060001:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e34a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.060013:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e34a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127479.060023:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000100:00080000:1.0:1789127479.060213:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789127479.060346:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e343 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffecd expref: 26 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.060362:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e34a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffecd expref: 25 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.060370:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:3.0:1789127479.060372:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789127479.060376:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b000, rc 0) 00000100:00100000:3.0:1789127479.060632:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d15e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+25:12670:x1876035771660544:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 795us (961us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789127479.060640:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 202 00000100:00100000:3.0:1789127479.068552:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127479.068635:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771660672 00000100:00100000:0.0:1789127479.068645:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771660672 00000100:00100000:0.0:1789127479.068700:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 203 00000100:00100000:0.0:1789127479.068716:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+25:12670:x1876035771660672:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:0.0:1789127479.068784:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e358 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.068799:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e358 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.068821:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e358 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.068836:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e35f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.068844:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e35f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.068850:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e35f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.068919:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e366 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.068927:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e366 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.068932:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e366 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127479.068972:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e366 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.068984:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e358 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.068990:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e358 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.068996:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e358 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069012:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127479.069016:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e358 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069023:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e358 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069035:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:0.0:1789127479.069037:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127479.069056:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e358 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069065:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e358 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069079:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e35f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069084:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e35f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069089:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e35f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069105:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127479.069108:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e35f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069113:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e35f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069131:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9346a69cb700) 00010000:00010000:0.0:1789127479.069134:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127479.069137:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e35f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069143:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e35f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069158:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e366 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069164:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e366 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069168:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e366 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069173:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fecc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127479.069176:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e366 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069181:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e366 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069188:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb300) 00010000:00010000:0.0:1789127479.069190:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127479.069193:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e366 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.069198:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e366 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127479.069276:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+25:12670:x1876035771660672:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 567us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127479.069284:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 203 00000100:00100000:1.0:1789127479.095825:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588d29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789549568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127479.095893:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127479.099772:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789549568 00000100:00100000:3.0:1789127479.099782:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789549568 00000100:00100000:3.0:1789127479.099900:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789127479.099910:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789549568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127479.099945:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127479.100009:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d2a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789549568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (4115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.100016:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789127479.100080:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789549952:0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.100116:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127479.100140:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789550464:0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.100160:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127479.100173:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789550976:0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.100192:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127479.100220:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1789127479.100225:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588d15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789549824:0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.100249:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127479.100268:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345887e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789550336:0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.100289:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127479.100304:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789550848:0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.100324:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127479.100338:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789551360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127479.100356:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789127479.100381:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127479.100394:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789549952 00000100:00100000:3.0:1789127479.100398:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789549952 00000100:00100000:3.0:1789127479.100422:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789550464 00000100:00100000:3.0:1789127479.100424:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789550464 00000100:00100000:3.0:1789127479.100438:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789550976 00000100:00100000:3.0:1789127479.100441:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789550976 00000100:00100000:3.0:1789127479.100465:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789127479.100471:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789549952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.100534:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587b0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789549952:12345-0@lo:400:kworker.0 Request processed in 37us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.100541:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789127479.100554:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789127479.100560:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789550464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.100586:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789550464:12345-0@lo:400:kworker.0 Request processed in 26us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.100592:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789127479.100602:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789127479.100608:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789550976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.100633:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7e8b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789550976:12345-0@lo:400:kworker.0 Request processed in 26us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.100639:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789127479.100656:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789549824 00000100:00100000:3.0:1789127479.100659:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789549824 00000100:00100000:3.0:1789127479.100684:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1789127479.100690:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789549824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.100720:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789549824:12345-0@lo:400:kworker.0 Request processed in 30us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.100726:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1789127479.100751:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789550336 00000100:00100000:3.0:1789127479.100755:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789550336 00000100:00100000:3.0:1789127479.100775:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789551360 00000100:00100000:3.0:1789127479.100778:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789551360 00000100:00100000:3.0:1789127479.100788:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789127479.100800:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789550336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.100831:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e73840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789550336:12345-0@lo:400:kworker.0 Request processed in 31us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.100837:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789127479.100848:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789127479.100853:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346812a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789551360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127479.100872:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789127479.100898:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346812a83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789551360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.100904:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789127479.100919:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789550848 00000100:00100000:3.0:1789127479.100922:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789550848 00000100:00100000:3.0:1789127479.100945:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789127479.100951:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789550848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.100977:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789550848:12345-0@lo:400:kworker.0 Request processed in 27us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.100983:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:3.0:1789127479.101000:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789127479.101003:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127479.101024:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588d15680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789549824:0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.101035:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345887e21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789550336:0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.101044:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789550848:0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.101072:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789551360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127479.101082:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789549952:0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.101102:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789550464:0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.101111:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789550976:0@lo:400:kworker.0 00000100:00100000:1.0:1789127479.105666:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588d14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789549696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127479.105767:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127479.105812:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789550208:0@lo:400:kworker.0 00000100:00100000:1.0:1789127479.105844:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127479.105995:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789549696 00000100:00100000:2.0:1789127479.106003:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789549696 00000100:00100000:1.0:1789127479.112127:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789550720:0@lo:400:kworker.0 00000100:00100000:1.0:1789127479.112185:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127479.112205:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789551232:0@lo:400:kworker.0 00000100:00100000:1.0:1789127479.112246:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127479.112275:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789127479.112281:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789550080:0@lo:400:kworker.0 00000100:00100000:1.0:1789127479.112304:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127479.112319:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789550592:0@lo:400:kworker.0 00000100:00100000:1.0:1789127479.112338:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127479.112352:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789551104:0@lo:400:kworker.0 00000100:00100000:1.0:1789127479.112369:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127479.112402:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789550720 00000100:00100000:1.0:1789127479.112415:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789550720 00000100:00100000:1.0:1789127479.112455:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789551232 00000100:00100000:1.0:1789127479.112458:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789551232 00000100:00100000:1.0:1789127479.112476:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789127479.112484:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458856c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789550720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127479.112546:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458856c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789550720:12345-0@lo:400:kworker.0 Request processed in 62us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127479.112553:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789127479.112567:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789127479.112573:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1876035789551232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127479.112596:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3653:x1876035789551232:12345-0@lo:400:kworker.0 Request processed in 24us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127479.112602:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789127479.112636:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eb9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789550720:0@lo:400:kworker.0 00000100:00100000:1.0:1789127479.112646:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789551232:0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.113616:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789550208 00000100:00100000:3.0:1789127479.113623:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789550208 00000100:00100000:3.0:1789127479.113674:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789550592 00000100:00100000:3.0:1789127479.113677:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789550592 00000100:00100000:3.0:1789127479.113692:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789551104 00000100:00100000:3.0:1789127479.113695:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789551104 00000100:00100000:3.0:1789127479.113711:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789127479.113729:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789550208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.113796:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d2bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789550208:12345-0@lo:400:kworker.0 Request processed in 78us (7950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.113803:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1789127479.113819:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789127479.113826:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789550592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.113852:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789550592:12345-0@lo:400:kworker.0 Request processed in 28us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.113858:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1789127479.113869:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1789127479.113875:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789551104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.113897:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789551104:12345-0@lo:400:kworker.0 Request processed in 23us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.113903:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1789127479.113922:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789550080 00000100:00100000:3.0:1789127479.113938:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789550080 00000100:00100000:3.0:1789127479.113962:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789127479.113978:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789550080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.114023:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789550080:12345-0@lo:400:kworker.0 Request processed in 45us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.114030:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789127479.114079:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789550080:0@lo:400:kworker.0 00010000:00080000:3.0:1789127479.114092:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ee61c0 x1876035789550592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127479.114103:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789550592:0@lo:400:kworker.0 00010000:00080000:3.0:1789127479.114113:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff93458840cf00 x1876035789551104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127479.114123:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789551104:0@lo:400:kworker.0 00000100:00100000:3.0:1789127479.114132:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789550208:0@lo:400:kworker.0 00000100:00100000:2.0:1789127479.115438:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789127479.115453:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588d2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789549696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127479.115600:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127479.115661:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588d2a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789549696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 213us (9894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127479.115669:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1789127479.115690:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127479.115696:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127479.115698:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127479.116650:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588d14780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789549696:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127479.123464:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:0.0:1789127479.123474:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:0.0:1789127479.123492:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff934588d283c0, transno 4294967308 00000100:00100000:0.0:1789127479.123537:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588d29a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789549568:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127479.123606:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127479.123709:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771660928 00000100:00100000:0.0:1789127479.123716:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771660928 00000100:00100000:0.0:1789127479.123769:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 204 00000100:00100000:0.0:1789127479.123779:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+25:12673:x1876035771660928:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127479.123795:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127479.123815:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e36d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffed4 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.123878:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e374 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.123891:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e374 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.123901:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e374 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.123915:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e37b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.123932:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.123938:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124037:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e382 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124058:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124066:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e382 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127479.124076:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1789127479.124147:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e374 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124155:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e374 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124161:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e374 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124167:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fedc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127479.124170:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e374 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124176:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e374 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124195:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:0.0:1789127479.124197:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127479.124202:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e374 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124207:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e374 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124216:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e37b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124221:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e37b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124227:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e37b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124232:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fede00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127479.124234:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e37b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124240:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e37b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.124246:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9346a69cb300) 00010000:00010000:0.0:1789127479.124248:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127479.125727:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e37b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.125744:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e37b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.125844:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e36d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffed4 expref: 28 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.125858:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffed4 expref: 27 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.125865:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:0.0:1789127479.125868:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127479.125870:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec400, rc 0) 00000100:00100000:0.0:1789127479.125929:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12673:x1876035771660928:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 2152us (2323us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1789127479.125938:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 204 00000100:00100000:0.0:1789127479.131183:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127479.131785:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771661056 00000100:00100000:0.0:1789127479.131795:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771661056 00000100:00100000:0.0:1789127479.131843:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 205 00000100:00100000:0.0:1789127479.131852:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12673:x1876035771661056:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:0.0:1789127479.131913:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e390 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.131927:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e390 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.131938:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e390 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.131969:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e390 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.131981:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e390 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.131987:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e390 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.131993:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127479.131998:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e390 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.132005:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e390 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.132018:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:0.0:1789127479.132021:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127479.132025:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e390 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.132030:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e390 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127479.132118:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12673:x1876035771661056:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 265us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127479.132126:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 205 00000100:00100000:0.0:1789127479.134331:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127479.134635:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771661312 00000100:00100000:1.0:1789127479.134643:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771661312 00000100:00100000:1.0:1789127479.134696:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:1.0:1789127479.134706:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12673:x1876035771661312:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1789127479.134906:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:12673:x1876035771661312:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 200us (582us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1789127479.134914:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:1.0:1789127479.160965:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127479.161037:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771661568 00000100:00100000:0.0:1789127479.161059:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771661568 00000100:00100000:0.0:1789127479.161120:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 206 00000100:00100000:0.0:1789127479.161130:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:12197:x1876035771661568:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1789127479.161180:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127479.161199:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e397 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffedb expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.161312:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.161325:0:9447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e382 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffed4 expref: 29 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.161334:0:9447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.161362:0:9447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffed4 expref: 29 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.161374:0:9447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e382 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffed4 expref: 29 pid: 9447 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127479.161388:0:9447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e19680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9447:1876035789551488:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127479.161485:0:9447:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127479.167183:0:9447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e19680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9447:1876035789551488:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127479.167212:0:9447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127479.167322:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127479.167392:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771661696 00000100:00100000:0.0:1789127479.167399:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771661696 00010000:00010000:0.0:1789127479.167437:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e382 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffed4 expref: 30 pid: 9447 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127479.167495:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 105 00000100:00100000:0.0:1789127479.167505:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+30:2401:x1876035771661696:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127479.167551:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127479.167559:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e382 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffed4 expref: 30 pid: 9447 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.167571:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e382 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffed4 expref: 30 pid: 9447 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.167592:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e382 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffed4 expref: 30 pid: 9447 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.167607:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:0.0:1789127479.167612:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.167621:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.167629:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.167650:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127479.167705:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:2401:x1876035771661696:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 201us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127479.167712:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 105 00010000:00010000:1.0:1789127479.168463:0:9447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.168495:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127479.168552:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789127479.168665:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e397 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffedb expref: 30 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.168681:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffedb expref: 29 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.168689:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:1.0:1789127479.168692:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789127479.168695:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec800, rc 0) 00000100:00100000:1.0:1789127479.168852:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:12197:x1876035771661568:12345-192.168.206.48@tcp:101:bash.0 Request processed in 7723us (7895us total) trans 4294967474 rc 0/0 00000100:00100000:1.0:1789127479.168861:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 206 00000100:00100000:1.0:1789127479.171770:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127479.171836:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771661824 00000100:00100000:0.0:1789127479.171855:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771661824 00000100:00100000:0.0:1789127479.171905:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 207 00000100:00100000:0.0:1789127479.171913:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:12197:x1876035771661824:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1789127479.171933:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127479.171951:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e3ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffee2 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.171982:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e3b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.171994:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.172006:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e3b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.172124:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e3ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffee2 expref: 31 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.172265:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e3b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffee2 expref: 30 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.172274:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:0.0:1789127479.172277:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127479.172280:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fedc00, rc 0) 00000100:00100000:0.0:1789127479.172338:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+30:12197:x1876035771661824:12345-192.168.206.48@tcp:101:bash.0 Request processed in 424us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127479.172345:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 207 00000100:00100000:2.0:1789127479.179807:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.180191:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771662080 00000100:00100000:3.0:1789127479.180204:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771662080 00000100:00100000:3.0:1789127479.180268:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 208 00000100:00100000:3.0:1789127479.180280:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+30:12197:x1876035771662080:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:3.0:1789127479.180501:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e3ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.180557:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e3ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.180569:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e3ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127479.180613:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1789127479.180659:0:6523:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fab82183 reply state 00000000a5c73e19 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e3ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.180671:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e3ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.180679:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:3.0:1789127479.180682:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127479.180685:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789127479.180735:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1789127479.180828:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+34:12197:x1876035771662080:12345-192.168.206.48@tcp:36:bash.0 Request processed in 549us (1029us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789127479.180835:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 208 00000020:00080000:3.0:1789127479.180840:0:6523:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789127479.182747:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127479.182834:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771662208 00000100:00100000:0.0:1789127479.182854:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771662208 00000100:00100000:0.0:1789127479.182905:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 209 00000100:00100000:0.0:1789127479.182915:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+34:12197:x1876035771662208:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1789127479.182935:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127479.182951:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e3c1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffee9 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.183002:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e3c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffee9 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.183015:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e3c1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffee9 expref: 35 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.183031:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:0.0:1789127479.183034:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127479.183037:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec400, rc 0) 00000100:00100000:0.0:1789127479.183307:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+35:12197:x1876035771662208:12345-192.168.206.48@tcp:101:bash.0 Request processed in 392us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127479.183315:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 209 00000100:00100000:0.0:1789127479.187503:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.187614:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771662336 00000100:00100000:3.0:1789127479.187623:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771662336 00000100:00100000:3.0:1789127479.187685:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:3.0:1789127479.187696:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e19680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:12197:x1876035771662336:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1789127479.187713:0:10363:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127479.187745:0:10363:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b383b30/0xd718aadfd785e3c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffef0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127479.187768:0:10363:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3eb32, atime: 0x6aa3eb30, ctime: 0x6aa3eb32, blocks: 0x8 00010000:00010000:3.0:1789127479.187789:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=440s v=(0 0) 00010000:00010000:3.0:1789127479.187794:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127479.187802:0:10363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b383b30/0xd718aadfd785e3c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffef0 expref: 8 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.187819:0:10363:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003b383b30/0xd718aadfd785e3c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffef0 expref: 8 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.187845:0:10363:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b600, rc 0) 00000100:00100000:3.0:1789127479.187909:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e19680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:12197:x1876035771662336:12345-192.168.206.48@tcp:101:bash.0 Request processed in 214us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.187916:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00080000:2.0:1789127479.188689:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127479.190652:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127479.190756:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771662464 00000100:00100000:0.0:1789127479.190766:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771662464 00002000:00010000:0.0:1789127479.190803:0:8443:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789127479.190808:0:8443:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9346b72abc00 with x1876035771662464 ext(0->18446744073709551615) 00002000:00010000:0.0:1789127479.190821:0:8443:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9346b72abc00. 00000100:00100000:0.0:1789127479.190853:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:0.0:1789127479.190864:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2402:x1876035771662464:12345-192.168.206.48@tcp:10:bash.0 00002000:00010000:0.0:1789127479.191414:0:8443:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789127479.191419:0:8443:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789127474 -> 1789127478 00002000:00010000:0.0:1789127479.191421:0:8443:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789127472 -> 1789127472 00002000:00010000:0.0:1789127479.191424:0:8443:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789127474 -> 1789127478 00002000:00010000:0.0:1789127479.191426:0:8443:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1789127479.191491:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72abc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2402:x1876035771662464:12345-192.168.206.48@tcp:10:bash.0 Request processed in 628us (847us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789127479.191500:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00002000:00010000:0.0:1789127479.191504:0:8443:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:0.0:1789127479.191773:0:8443:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9346b72abc00 with x1876035771662464 ext(0->18446744073709551615) 00002000:00010000:0.0:1789127479.191781:0:8443:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9346b72abc00. 00010000:00010000:0.0:1789127479.226065:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127479.261811:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.261957:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771662592 00000100:00100000:3.0:1789127479.261967:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771662592 00000100:00100000:3.0:1789127479.262028:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 210 00000100:00100000:3.0:1789127479.262039:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+35:12687:x1876035771662592:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:3.0:1789127479.262123:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3cf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262140:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262151:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262166:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262172:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262178:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262246:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e3dd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262274:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262282:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127479.262330:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262342:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3cf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262349:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3cf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262355:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262362:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127479.262367:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3cf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262376:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3cf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262387:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:3.0:1789127479.262390:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127479.262395:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262403:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262424:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262431:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262437:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262443:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501ae00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127479.262446:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262453:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262461:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff934586f6b000) 00010000:00010000:3.0:1789127479.262464:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127479.262467:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3d6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262473:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262761:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e3dd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262768:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e3dd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262773:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e3dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262798:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501ba00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127479.262801:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e3dd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262808:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e3dd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262817:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:3.0:1789127479.262819:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127479.262822:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e3dd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.262828:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e3dd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127479.262909:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+35:12687:x1876035771662592:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 871us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.262918:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 210 00000100:00100000:1.0:1789127479.299095:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.299233:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771662848 00000100:00100000:3.0:1789127479.299243:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771662848 00000100:00100000:3.0:1789127479.299305:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 211 00000100:00100000:3.0:1789127479.299315:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+35:12690:x1876035771662848:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127479.299334:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127479.299353:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e3e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffef7 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.299422:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3eb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.299456:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.299467:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.299498:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.299506:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.299556:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.299654:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e3f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.299664:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.299671:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e3f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127479.299681:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789127479.299766:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3eb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.299775:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3eb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.300149:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.300164:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501ae00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127479.300168:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3eb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.300175:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3eb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.300187:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:3.0:1789127479.300190:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127479.300194:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.300200:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e3eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.300211:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.300217:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3f2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.300223:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.300229:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127479.300232:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.300238:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3f2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.300256:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff934586f6b000) 00010000:00010000:3.0:1789127479.300259:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127479.300261:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3f2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.300267:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e3f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.301149:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e3e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffef7 expref: 38 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.301169:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e3f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffef7 expref: 37 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.301190:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:2.0:1789127479.301193:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789127479.301196:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b400, rc 0) 00000100:00100000:2.0:1789127479.301269:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+37:12690:x1876035771662848:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1955us (2182us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789127479.301277:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 211 00000100:00100000:2.0:1789127479.304367:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127479.304450:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771662976 00000100:00100000:1.0:1789127479.304459:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771662976 00000100:00100000:1.0:1789127479.304552:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 212 00000100:00100000:1.0:1789127479.304563:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+37:12690:x1876035771662976:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:1.0:1789127479.304624:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.304640:0:9447:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffedb expref: 37 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.304673:0:9447:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.304706:0:9447:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffedb expref: 37 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.304731:0:9447:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffedb expref: 37 pid: 9447 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127479.304745:0:9447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9447:1876035789551616:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789127479.305281:0:9447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346867f50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127479.308253:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127479.308321:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771663232 00000100:00100000:2.0:1789127479.308332:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771663232 00000100:00100000:2.0:1789127479.308388:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:2.0:1789127479.308399:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:6170:x1876035771663232:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789127479.308673:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+39:6170:x1876035771663232:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 275us (427us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789127479.308681:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:1.0:1789127479.309205:0:9447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9447:1876035789551616:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127479.309228:0:9447:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127479.311640:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.311713:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771663360 00000100:00100000:3.0:1789127479.311733:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771663360 00010000:00010000:3.0:1789127479.311770:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffedb expref: 39 pid: 9447 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127479.311814:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 106 00000100:00100000:3.0:1789127479.311824:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e75a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+39:2402:x1876035771663360:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127479.311838:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127479.311844:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffedb expref: 39 pid: 9447 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.311857:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffedb expref: 39 pid: 9447 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.311878:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e39e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffedb expref: 39 pid: 9447 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.311893:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:3.0:1789127479.311910:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.311920:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.311927:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.311962:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127479.312016:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e75a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:2402:x1876035771663360:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 193us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.312024:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 106 00010000:00010000:1.0:1789127479.312423:0:9447:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.312432:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.312468:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.312474:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.312479:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.312493:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858cc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127479.312497:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.312505:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.312549:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:1.0:1789127479.312552:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127479.312556:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.312563:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e407 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127479.312613:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+37:12690:x1876035771662976:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 8052us (8253us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127479.312621:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 212 00000100:00100000:2.0:1789127479.315799:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127479.315921:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771663616 00000100:00100000:1.0:1789127479.315932:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771663616 00000100:00100000:1.0:1789127479.315984:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:1.0:1789127479.315994:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+37:12690:x1876035771663616:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1789127479.316214:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:12690:x1876035771663616:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 221us (432us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789127479.316222:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:2.0:1789127479.384450:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127479.384585:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771663872 00000100:00100000:0.0:1789127479.384596:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771663872 00000100:00100000:3.0:1789127479.384802:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 213 00000100:00100000:3.0:1789127479.384815:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+38:12701:x1876035771663872:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:3.0:1789127479.384838:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127479.384859:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e40e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6efffefe expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385068:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e415 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385084:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e415 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385096:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e415 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385111:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e41c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385136:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e41c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385143:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e41c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385241:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e423 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385250:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e423 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385257:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e423 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127479.385266:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789127479.385334:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e415 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385341:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e415 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385347:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e415 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385353:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501ae00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127479.385357:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e415 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385364:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e415 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385456:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:3.0:1789127479.385460:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127479.385465:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e415 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385472:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e415 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385485:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e41c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385501:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e41c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385552:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e41c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385559:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501ac00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127479.385561:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e41c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385566:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e41c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385582:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff934586f6b000) 00010000:00010000:3.0:1789127479.385584:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127479.385587:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e41c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385592:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e41c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385684:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e40e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffefe expref: 41 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385699:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e423 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffefe expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.385706:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:3.0:1789127479.385708:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127479.385711:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501ba00, rc 0) 00000100:00100000:3.0:1789127479.385960:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+40:12701:x1876035771663872:12345-192.168.206.48@tcp:101:cat.0 Request processed in 1147us (1517us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1789127479.385968:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 213 00000100:00100000:2.0:1789127479.389914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127479.390043:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771664128 00000100:00100000:1.0:1789127479.390062:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771664128 00000100:00100000:1.0:1789127479.390258:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:1.0:1789127479.390281:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+40:12701:x1876035771664128:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:1.0:1789127479.390565:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+41:12701:x1876035771664128:12345-192.168.206.48@tcp:35:cat.0 Request processed in 285us (659us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1789127479.390574:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:1.0:1789127479.403753:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127479.403814:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771664384 00000100:00100000:0.0:1789127479.403823:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771664384 00000100:00100000:0.0:1789127479.403880:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 214 00000100:00100000:0.0:1789127479.403890:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b5453850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+41:12702:x1876035771664384:12345-192.168.206.48@tcp:36:rm.0 00010000:00010000:0.0:1789127479.404007:0:6522:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1789127479.404030:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e3c1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffee9 expref: 41 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404057:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e423 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffefe expref: 40 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404071:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e3f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffef7 expref: 39 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404099:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e3b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffee2 expref: 38 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404109:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:0.0:1789127479.404113:0:6522:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127479.404132:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e431 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404142:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e431 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404148:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e431 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404158:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e438 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404162:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e438 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404166:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e438 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404226:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e43f lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404233:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e43f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404238:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e43f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127479.404412:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1789127479.404419:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440596908838ns, next at 441596907108ns, rc = 0 00010000:00010000:0.0:1789127479.404451:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e446 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404456:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e446 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404461:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e446 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404466:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e446 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404470:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e446 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404474:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e446 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404655:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127479.404680:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e43f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404686:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e43f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404693:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e43f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404698:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127479.404709:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e43f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404724:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e43f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404734:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:0.0:1789127479.404737:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789127479.404741:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e43f lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404747:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e43f lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404761:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e431 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404768:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e431 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404773:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e431 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404778:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127479.404790:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e431 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404800:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e431 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.404806:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127479.404807:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:0.0:1789127479.404810:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127479.404812:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e446 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.404818:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed800 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127479.404818:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e431 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.404821:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e446 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404825:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e431 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127479.404834:0:6522:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c5670317 reply state 00000000520404de transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e438 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.404835:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e446 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.404844:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:0.0:1789127479.404845:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e438 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.404846:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789127479.404849:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e446 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.404851:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9346a69cb300) 00010000:00010000:0.0:1789127479.404853:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127479.404855:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e446 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127479.404855:0:6522:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789127479.404863:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127479.404865:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127479.404866:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127479.404930:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b5453850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+39:12702:x1876035771664384:12345-192.168.206.48@tcp:36:rm.0 Request processed in 1041us (1182us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1789127479.404938:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 214 00000100:00100000:2.0:1789127479.441053:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127479.441283:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771664640 00000100:00100000:1.0:1789127479.441293:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771664640 00000100:00100000:1.0:1789127479.441353:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 215 00000100:00100000:1.0:1789127479.441362:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+39:12708:x1876035771664640:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1789127479.441387:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127479.441410:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e44d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff05 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.441557:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785e454 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.441573:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785e454 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.441585:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785e454 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.441595:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e45b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.441602:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e45b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.441608:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e45b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789127479.442284:0:6524:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789127479.442422:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785e462 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.442432:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785e462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.442441:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785e462 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.442677:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785e454 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.442686:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785e454 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.442693:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785e454 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.442698:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858dc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127479.442702:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785e454 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.442710:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785e454 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.442746:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:1.0:1789127479.442750:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127479.442754:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785e454 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.442773:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785e454 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789127479.442787:0:6524:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ed3deb7d reply state 00000000d021d284 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e45b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.442799:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e45b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.442805:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9346a69cb300) 00010000:00010000:1.0:1789127479.442808:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789127479.442866:0:6524:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789127479.442896:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e44d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff05 expref: 42 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.442917:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785e462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff05 expref: 41 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.442923:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042300) 00010000:00010000:1.0:1789127479.442925:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127479.442927:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858ce00, rc 0) 00000100:00100000:1.0:1789127479.443000:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e77c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+42:12708:x1876035771664640:12345-192.168.206.48@tcp:101:bash.0 Request processed in 1639us (1969us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789127479.443008:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 215 00000100:00100000:2.0:1789127479.453248:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127479.453359:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771664768 00000100:00100000:1.0:1789127479.453368:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771664768 00000100:00100000:1.0:1789127479.453440:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:1.0:1789127479.453450:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771664768:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1789127479.453481:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127479.453501:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc5a1929/0xd718aadfd785e470 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff0c expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127479.453579:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127479.453599:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1789127479.453603:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127479.453612:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc5a1929/0xd718aadfd785e470 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff0c expref: 6 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.453637:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dc5a1929/0xd718aadfd785e470 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff0c expref: 6 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.453650:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c400, rc 0) 00000100:00100000:1.0:1789127479.453711:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e77840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2399:x1876035771664768:12345-192.168.206.48@tcp:101:bash.0 Request processed in 262us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127479.453718:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00080000:2.0:1789127479.453844:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127479.463952:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.464036:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771664896 00000100:00100000:3.0:1789127479.464058:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771664896 00000100:00100000:3.0:1789127479.464116:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:3.0:1789127479.464127:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:12708:x1876035771664896:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1789127479.464143:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127479.464160:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff13 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.464187:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc5a1929/0xd718aadfd785e470 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff0c expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.464196:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127479.464200:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127479.464204:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.464245:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc5a1929/0xd718aadfd785e470 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff0c expref: 7 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.464258:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc5a1929/0xd718aadfd785e470 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff0c expref: 7 pid: 8439 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127479.464272:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8438:1876035789551744:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127479.464359:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127479.470708:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8438:1876035789551744:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127479.470753:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 7 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.470774:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b800, rc 0) 00000100:00100000:3.0:1789127479.470834:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:12708:x1876035771664896:12345-192.168.206.48@tcp:101:bash.0 Request processed in 6708us (6890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.470843:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:2.0:1789127479.471602:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.471672:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771665024 00000100:00100000:3.0:1789127479.471679:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771665024 00010000:00010000:3.0:1789127479.471711:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc5a1929/0xd718aadfd785e470 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff0c expref: 7 pid: 8439 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127479.471765:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 107 00000100:00100000:3.0:1789127479.471774:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771665024:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127479.471802:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127479.471820:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc5a1929/0xd718aadfd785e470 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff0c expref: 7 pid: 8439 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.471833:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc5a1929/0xd718aadfd785e470 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff0c expref: 7 pid: 8439 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.471854:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc5a1929/0xd718aadfd785e470 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff0c expref: 7 pid: 8439 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.471912:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127479.471916:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127479.471925:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.471934:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.471968:0:6508:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127479.471981:0:6508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1876035789551872:192.168.206.48@tcp:105: 00000100:00100000:3.0:1789127479.472063:0:6508:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db50c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127479.477254:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.477367:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771665280 00000100:00100000:3.0:1789127479.477375:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771665280 00000100:00100000:0.0:1789127479.477392:0:6508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6508:1876035789551872:192.168.206.48@tcp:105: 00010000:00010000:0.0:1789127479.477413:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127479.477429:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:3.0:1789127479.477449:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+42:12708:x1876035771665280:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:0.0:1789127479.477466:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e743c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2402:x1876035771665024:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 5694us (5867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127479.477474:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 107 00000100:00100000:3.0:1789127479.477805:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e75680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+43:12708:x1876035771665280:12345-192.168.206.48@tcp:35:bash.0 Request processed in 356us (558us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789127479.477813:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:0.0:1789127479.608341:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789552000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127479.608410:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127479.608540:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789552000 00000100:00100000:3.0:1789127479.608548:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789552000 00000100:00100000:3.0:1789127479.608604:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789127479.608614:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789552000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789127479.608644:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789127479.608694:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789552000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.608701:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789127479.608744:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789552000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127479.611065:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127479.611082:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789552128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127479.611137:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127479.611183:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789552128 00000100:00100000:3.0:1789127479.611189:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789552128 00000100:00100000:3.0:1789127479.611228:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789127479.611237:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789552128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127479.611257:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789127479.611304:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789552128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.611311:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789127479.611349:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789552128:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127479.652415:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127479.652506:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771665408 00000100:00100000:1.0:1789127479.652549:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771665408 00000100:00100000:1.0:1789127479.652606:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 216 00000100:00100000:1.0:1789127479.652615:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+43:12724:x1876035771665408:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1789127479.652636:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127479.652654:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785e47e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff1a expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.652708:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e485 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.652733:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.652743:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127479.652784:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789127479.652788:0:9447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127479.652808:0:9447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e485 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.652830:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785e47e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff1a expref: 45 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.652859:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e485 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff1a expref: 44 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.652869:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:1.0:1789127479.652872:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127479.652875:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858d800, rc 0) 00000100:00100000:1.0:1789127479.652931:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e76d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+44:12724:x1876035771665408:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 316us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127479.652938:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 216 00000100:00100000:0.0:1789127479.655309:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.655360:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771665664 00000100:00100000:3.0:1789127479.655370:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771665664 00000100:00100000:3.0:1789127479.655459:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 217 00000100:00100000:3.0:1789127479.655469:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+44:12724:x1876035771665664:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127479.655487:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127479.655504:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e48c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff21 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.655641:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e493 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.655654:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.655664:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e493 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127479.655674:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789127479.655773:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e48c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff21 expref: 47 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.655790:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e493 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff21 expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.655798:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042300) 00010000:00010000:3.0:1789127479.655801:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127479.655804:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501ae00, rc 0) 00000100:00100000:3.0:1789127479.655882:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+46:12724:x1876035771665664:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 414us (579us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1789127479.655905:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 217 00000100:00100000:2.0:1789127479.658604:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.658704:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771665792 00000100:00100000:3.0:1789127479.658713:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771665792 00000100:00100000:3.0:1789127479.658790:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:3.0:1789127479.658802:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e74f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+46:2402:x1876035771665792:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127479.658816:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127479.658837:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e493 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff21 expref: 46 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.658855:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042300) 00010000:00010000:3.0:1789127479.658859:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127479.658912:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e74f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+45:2402:x1876035771665792:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 113us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.658921:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1789127479.667115:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127479.667206:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771666048 00000100:00100000:1.0:1789127479.667215:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771666048 00000100:00100000:1.0:1789127479.667271:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 218 00000100:00100000:1.0:1789127479.667281:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+45:12724:x1876035771666048:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1789127479.667302:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127479.667331:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785e4a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff28 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.667429:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e4a8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.667443:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e4a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.667455:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e4a8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127479.667467:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789127479.667599:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785e4a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff28 expref: 48 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.667616:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e4a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff28 expref: 47 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.667624:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042300) 00010000:00010000:1.0:1789127479.667626:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789127479.667629:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c000, rc 0) 00000100:00100000:1.0:1789127479.667675:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+47:12724:x1876035771666048:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 396us (569us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1789127479.667683:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 218 00000100:00100000:1.0:1789127479.676695:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127479.676786:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771666176 00000100:00100000:2.0:1789127479.676795:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771666176 00000100:00100000:2.0:1789127479.676894:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:2.0:1789127479.676905:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+6:2401:x1876035771666176:12345-192.168.206.48@tcp:1:lfs.0 00010000:00010000:2.0:1789127479.676946:0:8755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e4b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.676974:0:8755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.676982:0:8755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127479.676986:0:8755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127479.676991:0:8755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e4b6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.677022:0:8755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 6 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.677036:0:8755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 6 pid: 8438 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127479.677111:0:8755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e74780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8755:1876035789552256:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127479.677440:0:8755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127479.681499:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.681621:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771666304 00000100:00100000:3.0:1789127479.681631:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771666304 00002000:00100000:3.0:1789127479.681679:0:8445:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff934588e74000 x1876035771666304/t0(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:215/0 lens 504/0 e 0 to 0 dl 1789127490 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789127479.681690:0:8445:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff934588e74000 with x1876035771666304 ext(0->8) 00010000:00010000:3.0:1789127479.681699:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 7 pid: 8438 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.681714:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 7 pid: 8438 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127479.681735:0:8445:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff934588e74000 00000100:00100000:3.0:1789127479.681778:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:3.0:1789127479.681788:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771666304:12345-192.168.206.48@tcp:4:lfs.0 00000100:00100000:3.0:1789127479.682631:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2402:x1876035771666304:12345-192.168.206.48@tcp:4:lfs.0 Request processed in 841us (1138us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1789127479.682641:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00002000:00100000:3.0:1789127479.682649:0:8445:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff934588e74000 x1876035771666304/t4294967309(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:215/0 lens 504/448 e 0 to 0 dl 1789127490 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789127479.682659:0:8445:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff934588e74000 with x1876035771666304 ext(0->8) 00010000:00010000:3.0:1789127479.682666:0:8445:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 9 pid: 8438 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.682680:0:8445:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 9 pid: 8438 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127479.682687:0:8445:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff934588e74000 00000100:00100000:1.0:1789127479.682847:0:8755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e74780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8755:1876035789552256:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127479.682870:0:8755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e4b6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127479.690686:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127479.690924:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771666432 00000100:00100000:2.0:1789127479.690934:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771666432 00010000:00010000:2.0:1789127479.690975:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 9 pid: 8438 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127479.691341:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 108 00000100:00100000:2.0:1789127479.691363:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9dea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2402:x1876035771666432:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127479.691378:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789127479.691407:0:9539:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789127479.691409:0:9539:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789127478 00002000:00010000:2.0:1789127479.691411:0:9539:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789127478 00002000:00010000:2.0:1789127479.691413:0:9539:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789127478 00002000:00010000:2.0:1789127479.691414:0:9539:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789127479.691420:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 9 pid: 8438 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.691434:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 9 pid: 8438 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.691456:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e477 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff13 expref: 9 pid: 8438 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.691472:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127479.691477:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789127479.691483:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e4b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.691493:0:9539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e4b6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.691579:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127479.691641:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9dea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2402:x1876035771666432:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 290us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127479.691649:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 108 00010000:00010000:1.0:1789127479.691741:0:8755:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e4b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.691750:0:8755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e4b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.691774:0:8755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e4b6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.691783:0:8755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e4b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.691790:0:8755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e4b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.691798:0:8755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6e00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127479.691802:0:8755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e4b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.691811:0:8755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e4b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.691823:0:8755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e4b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.691842:0:8755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fadf391e/0xd718aadfd785e4b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127479.691889:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771666176:12345-192.168.206.48@tcp:1:lfs.0 Request processed in 14986us (15200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127479.691897:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:0.0:1789127479.696472:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.696575:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771666688 00000100:00100000:3.0:1789127479.696585:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771666688 00000100:00100000:3.0:1789127479.696637:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:3.0:1789127479.696647:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1ba9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+47:12724:x1876035771666688:12345-192.168.206.48@tcp:35:lfs.0 00000004:00010000:3.0:1789127479.696719:0:6525:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e4a8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff28 expref: 47 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127479.696933:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1789127479.696964:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1789127479.697446:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:3.0:1789127479.697486:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.697549:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785e462 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff05 expref: 51 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.697560:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.697594:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785e462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff05 expref: 51 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.697609:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785e462 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff05 expref: 51 pid: 6524 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127479.697623:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6525:1876035789552384:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127479.697835:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789127479.703355:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6525:1876035789552384:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127479.703385:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127479.705109:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.705305:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771666816 00000100:00100000:3.0:1789127479.705314:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771666816 00010000:00010000:3.0:1789127479.705348:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785e462 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff05 expref: 52 pid: 6524 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127479.705385:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 109 00000100:00100000:3.0:1789127479.705395:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+52:2401:x1876035771666816:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127479.705409:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127479.705416:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785e462 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff05 expref: 52 pid: 6524 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.705429:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785e462 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff05 expref: 52 pid: 6524 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.705462:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ce00/0xd718aadfd785e462 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff05 expref: 52 pid: 6524 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.705486:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042300) 00010000:00010000:3.0:1789127479.705491:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.705499:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.705505:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.705684:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127479.705855:0:6525:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.705863:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789127479.705958:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:1.0:1789127479.706073:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1789127479.706168:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1876035789552512:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789127479.706428:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e1ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+53:2401:x1876035771666816:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 1033us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.706438:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 109 00000100:00100000:1.0:1789127479.711691:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127479.711990:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1b1b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127479.712073:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789552512 00000100:00100000:3.0:1789127479.712083:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789552512 00000100:00100000:3.0:1789127479.712149:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789127479.712159:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1876035789552512:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789127479.712261:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6525:x1876035789552512:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 103us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127479.712268:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789127479.712541:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1876035789552512:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789127479.712678:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1789127479.712767:0:6525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1876035789552640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789127479.712797:0:6525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127479.712817:0:6525:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1b1b540 going to sleep for 11 seconds 00000100:00100000:3.0:1789127479.714012:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789552640 00000100:00100000:3.0:1789127479.714021:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789552640 00000100:00100000:3.0:1789127479.714085:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789127479.714095:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6525:x1876035789552640:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789127479.714501:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6525:x1876035789552640:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 407us (1701us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789127479.714526:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789127479.721935:0:6525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5d680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6525:1876035789552640:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789127479.722020:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1789127479.722095:0:6525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.722106:0:6525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.722114:0:6525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.722120:0:6525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501ae00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127479.722124:0:6525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.722146:0:6525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.722160:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042300) 00010000:00010000:0.0:1789127479.722163:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789127479.722168:0:6525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.722174:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4bd lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6525 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789127479.722275:0:6525:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789127479.722327:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:0.0:1789127479.722337:0:6525:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 440914826679ns, next at 441914824707ns, rc = 0 00000001:00080000:0.0:1789127479.722356:0:6525:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1789127479.722379:0:6525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042300) 00010000:00010000:0.0:1789127479.722382:0:6525:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789127479.722389:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c000/0xd718aadfd785e4a8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff28 expref: 55 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127479.722886:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1ba9450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+54:12724:x1876035771666688:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 26239us (26422us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1789127479.722897:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000020:00080000:0.0:1789127479.722903:0:6525:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789127479.731501:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127479.731583:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771666944 00000100:00100000:1.0:1789127479.731592:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771666944 00000100:00100000:1.0:1789127479.731636:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 219 00000100:00100000:1.0:1789127479.731644:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+54:12724:x1876035771666944:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1789127479.731676:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127479.731695:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e4c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff2f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.731765:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e4c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff2f expref: 55 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.731779:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e4c4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff2f expref: 55 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.731794:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:1.0:1789127479.731797:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789127479.731800:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c400, rc 0) 00000100:00100000:1.0:1789127479.732275:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+55:12724:x1876035771666944:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 630us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127479.732283:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 219 00000100:00100000:2.0:1789127479.742377:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127479.742442:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771667200 00000100:00100000:1.0:1789127479.742452:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771667200 00000100:00100000:1.0:1789127479.742564:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:1.0:1789127479.742574:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+55:12724:x1876035771667200:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1789127479.743127:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+56:12724:x1876035771667200:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 551us (755us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789127479.743399:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:0.0:1789127479.860030:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127479.860317:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771667328 00000100:00100000:1.0:1789127479.860328:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771667328 00000100:00100000:1.0:1789127479.860390:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 220 00000100:00100000:1.0:1789127479.860402:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+56:12735:x1876035771667328:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:1.0:1789127479.860502:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e4cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860557:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e4cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860571:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e4cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860583:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e4d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860591:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860598:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860663:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e4d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860671:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860679:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789127479.860909:0:9447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860923:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e4cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860941:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e4cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860949:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e4cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860955:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858cc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127479.860960:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e4cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860967:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e4cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860981:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:1.0:1789127479.860984:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127479.860988:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e4cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.860995:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e4cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.861007:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e4d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.861014:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e4d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.861020:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.861026:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127479.861036:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e4d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.861170:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e4d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.861181:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9346a69cb300) 00010000:00010000:1.0:1789127479.861184:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127479.861187:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e4d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.861192:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e4d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.861201:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e4d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.861206:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e4d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.861212:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.861217:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858de00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127479.861220:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e4d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.861226:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e4d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.861234:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:1.0:1789127479.861236:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127479.861245:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e4d9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127479.861251:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e4d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127479.861434:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+56:12735:x1876035771667328:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 1034us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127479.861444:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 220 00000100:00100000:2.0:1789127479.905129:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127479.905221:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771667584 00000100:00100000:3.0:1789127479.905231:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771667584 00000100:00100000:3.0:1789127479.905292:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 221 00000100:00100000:3.0:1789127479.905303:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+56:12738:x1876035771667584:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127479.905325:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127479.905345:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e4e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff36 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.905413:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4e7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.905427:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.905439:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.905448:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e4ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.905455:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.905461:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.905641:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e4f5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.905650:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127479.905656:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e4f5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127479.905664:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789127479.906131:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4e7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906139:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4e7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906146:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906152:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501ae00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127479.906155:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4e7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906163:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4e7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906174:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:2.0:1789127479.906178:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127479.906182:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4e7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906189:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ae00/0xd718aadfd785e4e7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906202:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e4ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906208:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e4ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906214:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e4ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906230:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127479.906233:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e4ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906239:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e4ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906247:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9346a69cb300) 00010000:00010000:2.0:1789127479.906249:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127479.906252:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e4ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906257:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b800/0xd718aadfd785e4ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906294:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e4e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff36 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906307:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff36 expref: 58 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127479.906313:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:2.0:1789127479.906315:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127479.906317:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b400, rc 0) 00000100:00100000:2.0:1789127479.906381:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e743c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+58:12738:x1876035771667584:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1080us (1261us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789127479.906389:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 221 00000100:00100000:2.0:1789127479.911274:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127479.911613:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771667712 00000100:00100000:0.0:1789127479.911621:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771667712 00000100:00100000:0.0:1789127479.911674:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 222 00000100:00100000:0.0:1789127479.911686:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+58:12738:x1876035771667712:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:0.0:1789127479.911771:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e503 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.911787:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.911799:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.911831:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e503 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.911838:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e503 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.911857:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e503 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.911863:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fede00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127479.911867:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e503 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.911875:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e503 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.911886:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:0.0:1789127479.911889:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127479.911894:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e503 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127479.911900:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e503 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127479.911972:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e74f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+58:12738:x1876035771667712:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 289us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127479.911980:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 222 00000100:00100000:0.0:1789127479.916610:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127479.916838:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771667968 00000100:00100000:1.0:1789127479.916849:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771667968 00000100:00100000:1.0:1789127479.916923:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:1.0:1789127479.916934:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+58:12738:x1876035771667968:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1789127479.917182:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:12738:x1876035771667968:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 250us (581us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789127479.917190:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:2.0:1789127480.007794:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127480.007991:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771668224 00000100:00100000:1.0:1789127480.008001:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771668224 00000100:00100000:1.0:1789127480.008071:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 223 00000100:00100000:1.0:1789127480.008082:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:12748:x1876035771668224:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1789127480.008107:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127480.008110:0:6524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789127480.008136:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e485 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff1a expref: 59 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.008155:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:1.0:1789127480.008160:0:6524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127480.008172:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e50a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff3d expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.008291:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.008306:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e4f5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff36 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.008314:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.008348:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff36 expref: 59 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.008363:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e4f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff36 expref: 59 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127480.008376:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789552768:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789127480.008472:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1b1b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789127480.012986:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127480.013099:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789552768:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127480.013126:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127480.013229:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771668352 00000100:00100000:0.0:1789127480.013236:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771668352 00010000:00010000:0.0:1789127480.013271:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e4f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff36 expref: 60 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127480.013311:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 110 00000100:00100000:0.0:1789127480.013320:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:2402:x1876035771668352:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127480.013342:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127480.013360:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e4f5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff36 expref: 60 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.013372:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e4f5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff36 expref: 60 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.013393:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e4f5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff36 expref: 60 pid: 6523 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.013407:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:0.0:1789127480.013411:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.013421:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.013428:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.013456:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127480.013544:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:2402:x1876035771668352:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 224us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127480.013552:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 110 00010000:00010000:1.0:1789127480.013637:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.013645:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127480.013664:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789127480.013803:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858de00/0xd718aadfd785e50a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff3d expref: 60 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.013819:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff3d expref: 59 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.013827:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:1.0:1789127480.013829:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789127480.013832:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c200, rc 0) 00000100:00100000:1.0:1789127480.013859:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e74b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:12748:x1876035771668224:12345-192.168.206.48@tcp:101:bash.0 Request processed in 5780us (6074us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1789127480.013866:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 223 00000100:00100000:0.0:1789127480.018790:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127480.018915:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771668480 00000100:00100000:3.0:1789127480.018924:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771668480 00000100:00100000:3.0:1789127480.018977:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 224 00000100:00100000:3.0:1789127480.018987:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+59:12748:x1876035771668480:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1789127480.019008:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127480.019026:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e51f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff44 expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.019072:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e526 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.019086:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.019095:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e526 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.019204:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e51f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff44 expref: 61 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.019233:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff44 expref: 60 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.019242:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:3.0:1789127480.019245:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789127480.019249:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b400, rc 0) 00000100:00100000:3.0:1789127480.019310:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:12748:x1876035771668480:12345-192.168.206.48@tcp:101:bash.0 Request processed in 324us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127480.019317:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 224 00000100:00100000:3.0:1789127480.028832:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127480.028985:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771668736 00000100:00100000:2.0:1789127480.028994:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771668736 00000100:00100000:2.0:1789127480.029062:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 225 00000100:00100000:2.0:1789127480.029073:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+60:12748:x1876035771668736:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:2.0:1789127480.029280:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e52d lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127480.029298:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e52d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127480.029308:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e52d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789127480.029348:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1789127480.029368:0:6523:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e2fb404c reply state 00000000e243741a transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e52d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127480.029380:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e52d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127480.029387:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:2.0:1789127480.029389:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789127480.029392:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789127480.029477:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+63:12748:x1876035771668736:12345-192.168.206.48@tcp:36:bash.0 Request processed in 406us (655us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789127480.029485:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 225 00000020:00080000:2.0:1789127480.029489:0:6523:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789127480.038890:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127480.039833:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771668864 00000100:00100000:3.0:1789127480.039844:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771668864 00000100:00100000:3.0:1789127480.039907:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 226 00000100:00100000:3.0:1789127480.039916:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+63:12748:x1876035771668864:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1789127480.039938:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127480.039958:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e534 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff4b expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.040060:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.040074:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff3d expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.040083:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.040144:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff3d expref: 64 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.040158:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff3d expref: 64 pid: 6524 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127480.040172:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebc780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789552896:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127480.040264:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5000 going to sleep for 11 seconds 00000100:00100000:0.0:1789127480.047710:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127480.047806:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771668992 00000100:00100000:2.0:1789127480.047814:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771668992 00010000:00010000:2.0:1789127480.047855:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff3d expref: 65 pid: 6524 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127480.047894:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 111 00000100:00100000:2.0:1789127480.047903:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e18780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+65:2401:x1876035771668992:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127480.047918:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127480.047925:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff3d expref: 65 pid: 6524 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127480.047939:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff3d expref: 65 pid: 6524 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127480.047960:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:2.0:1789127480.047965:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127480.047975:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127480.047981:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127480.048000:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127480.048069:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e18780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+65:2401:x1876035771668992:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 167us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127480.048076:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 111 00010000:00010000:3.0:1789127480.048668:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c200/0xd718aadfd785e511 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff3d expref: 64 pid: 6524 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127480.048685:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebc780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789552896:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127480.048704:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.048712:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.048717:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127480.048765:0:6522:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789127480.048770:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127480.048788:0:6522:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.048818:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ba00/0xd718aadfd785e534 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff4b expref: 64 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.048844:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff4b expref: 63 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.048851:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:3.0:1789127480.048854:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127480.048856:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501ac00, rc 0) 00000100:00100000:3.0:1789127480.048901:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e76580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+63:12748:x1876035771668864:12345-192.168.206.48@tcp:101:bash.0 Request processed in 8986us (10018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127480.048908:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 226 00000100:00100000:0.0:1789127480.059652:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127480.059764:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771669248 00000100:00100000:1.0:1789127480.059774:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771669248 00000100:00100000:1.0:1789127480.059832:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:1.0:1789127480.059841:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+63:12748:x1876035771669248:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:1.0:1789127480.060060:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+64:12748:x1876035771669248:12345-192.168.206.48@tcp:35:bash.0 Request processed in 219us (417us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789127480.060068:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:2.0:1789127480.129584:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127480.129678:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771669376 00000100:00100000:0.0:1789127480.129687:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771669376 00000100:00100000:0.0:1789127480.129770:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 227 00000100:00100000:0.0:1789127480.129781:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+64:12754:x1876035771669376:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127480.129805:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127480.129826:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e542 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff52 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.129888:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e549 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.129902:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.129914:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127480.129958:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789127480.129962:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127480.129981:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e549 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.130002:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e542 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff52 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.130019:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e549 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff52 expref: 65 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.130026:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:0.0:1789127480.130029:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127480.130032:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec800, rc 0) 00000100:00100000:0.0:1789127480.130109:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e761c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+65:12754:x1876035771669376:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 329us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127480.130122:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 227 00000100:00100000:3.0:1789127480.134286:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127480.134381:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771669504 00000100:00100000:1.0:1789127480.134390:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771669504 00000100:00100000:1.0:1789127480.134444:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 228 00000100:00100000:1.0:1789127480.134455:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+65:12754:x1876035771669504:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1789127480.134473:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127480.134503:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e550 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff59 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134614:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e557 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134628:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e557 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134639:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e557 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134650:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e55e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134658:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e55e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134664:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e55e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134740:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e565 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134750:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134757:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127480.134792:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789127480.134797:0:9447:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127480.134812:0:9447:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134833:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e565 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134841:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e557 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134847:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e557 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134853:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e557 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134859:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858cc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127480.134863:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e557 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134869:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e557 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134880:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:1.0:1789127480.134883:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127480.134887:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e557 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134894:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e557 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134906:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e55e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134911:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e55e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134923:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e55e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134927:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127480.134930:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e55e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134935:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e55e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134943:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9346a69cb300) 00010000:00010000:1.0:1789127480.134945:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127480.134948:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e55e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134954:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e55e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134980:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e550 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff59 expref: 67 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.134994:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff59 expref: 66 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.135001:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:1.0:1789127480.135004:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127480.135006:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858d600, rc 0) 00000100:00100000:1.0:1789127480.135307:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+66:12754:x1876035771669504:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 853us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.135324:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 228 00000100:00100000:2.0:1789127480.139373:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127480.139466:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771669760 00000100:00100000:0.0:1789127480.139486:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771669760 00000100:00100000:0.0:1789127480.139565:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 229 00000100:00100000:0.0:1789127480.139575:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+66:12754:x1876035771669760:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127480.139594:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127480.139612:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e56c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff60 expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.139704:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.139717:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff4b expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.139739:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e565 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff59 expref: 67 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.139746:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.139775:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff59 expref: 67 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.139786:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e565 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff59 expref: 67 pid: 9447 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127480.139798:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e18b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789553024:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127480.139901:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff4b expref: 67 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.139910:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff4b expref: 67 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127480.139918:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e1a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789553152:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127480.139941:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127480.143733:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127480.143801:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127480.143908:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e18b40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789553024:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127480.143920:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e1a580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789553152:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127480.143942:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127480.144009:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771669888 00000100:00100000:3.0:1789127480.144017:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771669888 00010000:00010000:3.0:1789127480.144069:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e565 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff59 expref: 68 pid: 9447 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127480.144102:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771670016 00000100:00100000:3.0:1789127480.144106:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771670016 00010000:00010000:3.0:1789127480.144119:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff4b expref: 69 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127480.144155:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:3.0:1789127480.144164:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e75680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+69:2399:x1876035771669888:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127480.144178:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127480.144184:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e565 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff59 expref: 69 pid: 9447 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.144207:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e565 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff59 expref: 69 pid: 9447 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.144229:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e565 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff59 expref: 69 pid: 9447 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.144244:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:3.0:1789127480.144249:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.144258:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.144264:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127480.144312:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e75680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+68:2399:x1876035771669888:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 149us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127480.144321:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 112 00000100:00100000:3.0:1789127480.144338:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:3.0:1789127480.144345:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e74780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+67:2402:x1876035771670016:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127480.144352:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127480.144357:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff4b expref: 67 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.144366:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff4b expref: 67 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.144390:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501ac00/0xd718aadfd785e53b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff4b expref: 67 pid: 6522 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.144400:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:3.0:1789127480.144403:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.144411:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.144419:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.144437:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127480.144458:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e74780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+66:2402:x1876035771670016:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 113us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127480.144464:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 113 00010000:00010000:0.0:1789127480.144865:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.144873:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127480.144890:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789127480.145007:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e56c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff60 expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.145021:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff60 expref: 66 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127480.145031:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:0.0:1789127480.145058:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789127480.145062:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec000, rc 0) 00000100:00100000:0.0:1789127480.145095:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e76940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+66:12754:x1876035771669760:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 5523us (5732us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1789127480.145102:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 229 00000100:00100000:2.0:1789127480.149553:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127480.149646:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771670272 00000100:00100000:3.0:1789127480.149657:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771670272 00000100:00100000:3.0:1789127480.149726:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:3.0:1789127480.149736:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+66:12754:x1876035771670272:12345-192.168.206.48@tcp:103:lfs.0 00010000:00010000:3.0:1789127480.149752:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127480.149775:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c400/0xd718aadfd785e4c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff2f expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127480.149791:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:3.0:1789127480.149795:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127480.149862:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e770c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+65:12754:x1876035771670272:12345-192.168.206.48@tcp:103:lfs.0 Request processed in 127us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127480.149870:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:3.0:1789127480.152079:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127480.152173:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771670400 00000100:00100000:1.0:1789127480.152183:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771670400 00000100:00100000:1.0:1789127480.152248:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 230 00000100:00100000:1.0:1789127480.152262:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+65:12754:x1876035771670400:12345-192.168.206.48@tcp:58:lfs.0 00010000:00010000:1.0:1789127480.152379:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e581 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.152397:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.152409:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127480.152573:0:9447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789127480.152638:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+65:12754:x1876035771670400:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 381us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.152647:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 230 00000100:00100000:2.0:1789127480.155590:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127480.155735:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771670528 00000100:00100000:1.0:1789127480.155744:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771670528 00000100:00100000:1.0:1789127480.155798:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 231 00000100:00100000:1.0:1789127480.155807:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+65:12754:x1876035771670528:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1789127480.155824:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127480.155842:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e588 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff67 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.155885:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e581 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.155911:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e588 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff67 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.155928:0:6524:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.155940:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e588 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff67 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.155952:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:1.0:1789127480.155954:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789127480.155958:0:6524:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e588 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff67 expref: 66 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127480.155965:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c600, rc 0) 00000100:00100000:1.0:1789127480.156013:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e752c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+66:12754:x1876035771670528:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 208us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127480.156021:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 231 00010000:00010000:1.0:1789127480.247741:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789127481.016334:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789127481.016342:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127481.016367:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789127481.016375:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789127481.016497:0:14502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14502:1876035789553280:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789127481.017181:0:14502:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127481.021187:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127481.021433:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771670656 00000100:00100000:1.0:1789127481.021442:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771670656 00000100:00100000:1.0:1789127481.021538:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 232 00000100:00100000:1.0:1789127481.021549:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690407c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+67:12755:x1876035771670656:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789127481.021591:0:9447:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789127481.021692:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690407c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+67:12755:x1876035771670656:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 145us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127481.021712:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 232 00000100:00100000:3.0:1789127481.022007:0:14502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe580 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14502:1876035789553280:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00080000:2.0:1789127481.022485:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789127481.026460:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127481.026579:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771670784 00000100:00100000:1.0:1789127481.026589:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771670784 00000100:00100000:1.0:1789127481.026662:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 233 00000100:00100000:1.0:1789127481.026673:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690406940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+66:12755:x1876035771670784:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789127481.026763:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e58f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.026780:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e58f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.026795:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e58f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.026810:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e596 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.026817:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e596 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.026823:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e596 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.026845:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e59d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.026853:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e59d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.026860:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e59d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127481.026918:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789127481.026922:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127481.026936:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e59d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.026948:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e58f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.026955:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e58f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.026961:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e58f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.026967:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858cc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127481.026972:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e58f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.026979:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e58f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.026991:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4200) 00010000:00010000:1.0:1789127481.026994:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127481.027000:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e58f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027006:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e58f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027020:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e596 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027055:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e596 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027062:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e596 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027067:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858da00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127481.027070:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e596 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027077:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e596 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027086:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff93468b042200) 00010000:00010000:1.0:1789127481.027089:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127481.027091:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e596 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027098:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e596 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027113:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e59d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027120:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e59d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027483:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e59d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027489:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858ca00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127481.027497:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e59d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027504:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e59d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027556:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:1.0:1789127481.027558:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127481.027665:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e59d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.027672:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e59d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127481.027767:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690406940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+66:12755:x1876035771670784:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 1094us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127481.027776:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 233 00000100:00100000:3.0:1789127481.032899:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127481.033166:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771671040 00000100:00100000:1.0:1789127481.033177:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771671040 00000100:00100000:1.0:1789127481.033238:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 234 00000100:00100000:1.0:1789127481.033249:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+66:12755:x1876035771671040:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127481.033268:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127481.033286:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff6e expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.033398:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.033413:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.033444:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127481.033457:0:9447:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789127481.033554:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.033561:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5ab lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.033582:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.033588:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858cc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127481.033592:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.033599:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5ab lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.033610:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:1.0:1789127481.033613:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789127481.033618:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5ab lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.033624:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.033664:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5a4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff6e expref: 68 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.033688:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4200) 00010000:00010000:1.0:1789127481.033691:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127481.033695:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff6e expref: 68 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.033705:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858da00, rc 0) 00000100:00100000:1.0:1789127481.033785:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+67:12755:x1876035771671040:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 537us (893us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1789127481.033792:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 234 00000100:00100000:2.0:1789127481.041976:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127481.042112:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771671168 00000100:00100000:0.0:1789127481.042130:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771671168 00000100:00100000:0.0:1789127481.042186:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 235 00000100:00100000:0.0:1789127481.042197:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690407840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+67:12755:x1876035771671168:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789127481.042234:0:6523:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789127481.042343:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690407840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+67:12755:x1876035771671168:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 148us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127481.042350:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 235 00000100:00100000:2.0:1789127481.055650:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127481.055780:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771671424 00000100:00100000:1.0:1789127481.055790:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771671424 00000100:00100000:1.0:1789127481.055855:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 236 00000100:00100000:1.0:1789127481.055865:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690405e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+67:12755:x1876035771671424:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127481.055884:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127481.055888:0:9447:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789127481.055913:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e549 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff52 expref: 67 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.055930:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:1.0:1789127481.055934:0:9447:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789127481.055946:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff75 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789127481.056281:0:9447:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1789127481.056422:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5c0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.056448:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.056457:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5c0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.056504:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff75 expref: 69 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.056581:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5c0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff75 expref: 68 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.056589:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042200) 00010000:00010000:1.0:1789127481.056592:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127481.056594:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858cc00, rc 0) 00000100:00100000:1.0:1789127481.056646:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690405e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+68:12755:x1876035771671424:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 783us (1007us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789127481.056654:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 236 00000100:00100000:3.0:1789127481.066680:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127481.066816:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771671680 00000100:00100000:0.0:1789127481.066825:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771671680 00000100:00100000:0.0:1789127481.066878:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 237 00000100:00100000:0.0:1789127481.066887:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+68:12755:x1876035771671680:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789127481.066937:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127481.066962:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e5c0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff75 expref: 68 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.066978:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042200) 00010000:00010000:0.0:1789127481.066987:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127481.067006:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e5ce lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067018:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e5ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067055:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e5ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067072:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5d5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x82a83627 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067079:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x82a83627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067085:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x82a83627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067136:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e5ce lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067143:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e5ce lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067149:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e5ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067154:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fedc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127481.067158:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e5ce lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067165:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e5ce lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067172:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:0.0:1789127481.067174:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127481.067178:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e5ce lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067189:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e5ce lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067199:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5d5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x82a83627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067204:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5d5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x82a83627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067209:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x82a83627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067212:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127481.067215:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5d5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x82a83627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067220:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5d5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x82a83627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067226:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x82a83627 (ffff934692a00300) 00010000:00010000:0.0:1789127481.067228:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127481.067230:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5d5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x82a83627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.067235:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5d5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x82a83627 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127481.067316:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+67:12755:x1876035771671680:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 429us (644us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127481.067323:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 237 00000100:00100000:2.0:1789127481.076235:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127481.076504:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771671808 00000100:00100000:1.0:1789127481.076557:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771671808 00000100:00100000:1.0:1789127481.076627:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 238 00000100:00100000:1.0:1789127481.076637:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690404f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+67:12755:x1876035771671808:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127481.076656:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127481.076676:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5dc lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff7c expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.076711:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e5e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.076746:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.076756:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e5e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.076853:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff7c expref: 69 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.076869:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff7c expref: 68 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.076878:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042e00) 00010000:00010000:1.0:1789127481.076880:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789127481.076884:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858ca00, rc 0) 00000100:00100000:1.0:1789127481.076946:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690404f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+68:12755:x1876035771671808:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 310us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127481.076953:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 238 00000100:00100000:2.0:1789127481.079831:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127481.079923:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771672064 00000100:00100000:0.0:1789127481.079931:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771672064 00000100:00100000:0.0:1789127481.079981:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 239 00000100:00100000:0.0:1789127481.079990:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+68:12755:x1876035771672064:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789127481.080072:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.080086:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.080096:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127481.080247:0:6523:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1789127481.080257:0:6523:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 442272747227ns, next at 443272744237ns, rc = 0 00000004:00010000:0.0:1789127481.080305:0:6523:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006552eb8c reply state 000000001846d8fa transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.080318:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.080325:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042e00) 00010000:00010000:0.0:1789127481.080328:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789127481.080331:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127481.080432:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+70:12755:x1876035771672064:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 443us (610us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789127481.080439:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 239 00000100:00100000:2.0:1789127481.083583:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127481.083804:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771672192 00000100:00100000:1.0:1789127481.083814:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771672192 00000100:00100000:1.0:1789127481.083875:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 240 00000100:00100000:1.0:1789127481.083885:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+70:12755:x1876035771672192:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127481.083907:0:9447:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127481.083926:0:9447:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff83 expref: -99 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.083974:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff83 expref: 71 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.084001:0:9447:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff83 expref: 71 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.084019:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042e00) 00010000:00010000:1.0:1789127481.084022:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789127481.084025:0:9447:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858da00, rc 0) 00000100:00100000:1.0:1789127481.084498:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+71:12755:x1876035771672192:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 612us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127481.084506:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 240 00000100:00100000:2.0:1789127481.103761:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127481.103853:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771672320 00000100:00100000:3.0:1789127481.103863:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771672320 00000100:00100000:3.0:1789127481.103937:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:3.0:1789127481.103948:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690406d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2399:x1876035771672320:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789127481.104282:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690406d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+10:2399:x1876035771672320:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 336us (527us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789127481.104290:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00080000:2.0:1789127481.104394:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127481.108688:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127481.108803:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771672576 00000100:00100000:1.0:1789127481.108814:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771672576 00000100:00100000:1.0:1789127481.108904:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:1.0:1789127481.108915:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+71:12755:x1876035771672576:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789127481.109324:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+72:12755:x1876035771672576:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 409us (810us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1789127481.109333:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:1.0:1789127481.117273:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127481.117381:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771672832 00000100:00100000:0.0:1789127481.117390:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771672832 00000100:00100000:0.0:1789127481.117445:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 241 00000100:00100000:0.0:1789127481.117455:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+72:12755:x1876035771672832:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789127481.117845:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+72:12755:x1876035771672832:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 389us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127481.117853:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 241 00000100:00100000:3.0:1789127481.124762:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127481.124938:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771672960 00000100:00100000:0.0:1789127481.124948:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771672960 00000100:00100000:0.0:1789127481.125257:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 242 00000100:00100000:0.0:1789127481.125269:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+72:12755:x1876035771672960:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789127481.125291:0:6522:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127481.125313:0:6522:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e5f8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff8a expref: -99 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.125377:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e5ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.125390:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e5ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.125399:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e5ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127481.125439:0:6522:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127481.125456:0:6522:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e5ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.125479:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fedc00/0xd718aadfd785e5f8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff8a expref: 74 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.125495:0:6522:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e5ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff8a expref: 73 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.125579:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042e00) 00010000:00010000:0.0:1789127481.125581:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789127481.125585:0:6522:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec800, rc 0) 00000100:00100000:0.0:1789127481.125635:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+73:12755:x1876035771672960:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 369us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127481.125642:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 242 00000100:00100000:2.0:1789127481.136407:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127481.137671:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771673088 00000100:00100000:3.0:1789127481.137683:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771673088 00000100:00100000:3.0:1789127481.137753:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:3.0:1789127481.137765:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+10:2402:x1876035771673088:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127481.137782:0:8438:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127481.137815:0:8438:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e606 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff91 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789127481.137839:0:8438:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3eb38, blocks: 0x0 00010000:00010000:3.0:1789127481.137858:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1789127481.137863:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127481.137872:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e606 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff91 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.137903:0:8438:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e606 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff91 expref: 11 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.137917:0:8438:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501ac00, rc 0) 00000100:00100000:3.0:1789127481.137980:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e703c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+11:2402:x1876035771673088:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 217us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127481.137987:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:2.0:1789127481.147670:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127481.147768:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771673344 00000100:00100000:0.0:1789127481.147779:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771673344 00000100:00100000:0.0:1789127481.147843:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 243 00000100:00100000:0.0:1789127481.147854:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+73:12755:x1876035771673344:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789127481.147970:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e71680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+73:12755:x1876035771673344:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 118us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127481.147978:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 243 00000100:00100000:2.0:1789127481.150876:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127481.151328:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771673472 00000100:00100000:1.0:1789127481.151338:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771673472 00000100:00100000:1.0:1789127481.151438:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:1.0:1789127481.151449:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+11:12755:x1876035771673472:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789127481.151473:0:8755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127481.151491:0:8755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dc5a1929/0xd718aadfd785e60d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff98 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.151584:0:8755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e606 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff91 expref: 12 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.151594:0:8755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127481.151598:0:8755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127481.151604:0:8755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc5a1929/0xd718aadfd785e60d lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff98 expref: 12 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.151638:0:8755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e606 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff91 expref: 12 pid: 8438 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.151652:0:8755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e606 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff91 expref: 12 pid: 8438 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127481.151667:0:8755:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8755:1876035789553408:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789127481.151930:0:8755:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1b1bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127481.155575:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127481.156360:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771673600 00000100:00100000:3.0:1789127481.156370:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771673600 00010000:00010000:3.0:1789127481.156411:0:9539:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e606 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff91 expref: 13 pid: 8438 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127481.156456:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:3.0:1789127481.156465:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9deb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+13:2401:x1876035771673600:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127481.156492:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127481.156542:0:9539:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e606 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff91 expref: 13 pid: 8438 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.156574:0:9539:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e606 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff91 expref: 13 pid: 8438 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.156599:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127481.156604:0:9539:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127481.156612:0:9539:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc5a1929/0xd718aadfd785e60d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff98 expref: 13 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.156621:0:9539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dc5a1929/0xd718aadfd785e60d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff98 expref: 13 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.156668:0:9539:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dc5a1929/0xd718aadfd785e60d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff98 expref: 13 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127481.156683:0:9539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9539:1876035789553536:192.168.206.48@tcp:105: 00000100:00100000:3.0:1789127481.156825:0:9539:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5a80 going to sleep for 11 seconds 00010000:00010000:1.0:1789127481.157338:0:8755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785e606 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff91 expref: 13 pid: 8438 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127481.157355:0:8755:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5c780 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8755:1876035789553408:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127481.157378:0:8755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dc5a1929/0xd718aadfd785e60d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff98 expref: 12 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.157388:0:8755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c400, rc 0) 00000100:00100000:1.0:1789127481.157430:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+12:12755:x1876035771673472:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 5984us (6562us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127481.157439:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:2.0:1789127481.163195:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127481.163309:0:8443:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771673728 00000100:00100000:0.0:1789127481.163318:0:8443:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771673728 00002000:00100000:0.0:1789127481.163365:0:8443:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff934587e70f00 x1876035771673728/t0(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:217/0 lens 504/0 e 0 to 0 dl 1789127492 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789127481.163375:0:8443:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff934587e70f00 with x1876035771673728 ext(0->12) 00000100:00100000:3.0:1789127481.163376:0:9539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9539:1876035789553536:192.168.206.48@tcp:105: 00002000:00010000:0.0:1789127481.163380:0:8443:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff934587e70f00 00010000:00010000:3.0:1789127481.163395:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127481.163445:0:8443:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1789127481.163455:0:8443:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e70f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+12:2401:x1876035771673728:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789127481.163485:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9deb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+12:2401:x1876035771673600:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 7021us (7918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127481.163494:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:0.0:1789127481.164301:0:8443:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e70f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+13:2401:x1876035771673728:12345-192.168.206.48@tcp:4:lhsmtool_posix.0 Request processed in 843us (1179us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789127481.164323:0:8443:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00002000:00100000:0.0:1789127481.164332:0:8443:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff934587e70f00 x1876035771673728/t4294967321(0) o4->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:217/0 lens 504/448 e 0 to 0 dl 1789127492 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789127481.164342:0:8443:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff934587e70f00 with x1876035771673728 ext(0->12) 00002000:00010000:0.0:1789127481.164346:0:8443:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff934587e70f00 00000100:00100000:0.0:1789127481.166388:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127481.166480:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771673856 00000100:00100000:1.0:1789127481.166488:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771673856 00000100:00100000:1.0:1789127481.166646:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 244 00000100:00100000:1.0:1789127481.166657:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+73:12755:x1876035771673856:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789127481.168498:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00010000:00010000:3.0:1789127481.168611:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e312 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168625:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e312 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168644:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e312 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168650:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501aa00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127481.168655:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e312 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168663:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e312 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168681:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff93468b042d00) 00010000:00010000:3.0:1789127481.168684:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127481.168689:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e312 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168696:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e312 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168728:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e3ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168735:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e3ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168741:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e3ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168746:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127481.168749:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e3ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168765:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e3ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168774:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9346a69cb700) 00010000:00010000:3.0:1789127481.168776:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127481.168780:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e3ba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168786:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e3ba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168802:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e438 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168809:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e438 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168814:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e438 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168820:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fecc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127481.168822:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e438 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168829:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e438 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168836:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9346a69cb300) 00010000:00010000:3.0:1789127481.168838:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127481.168841:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e438 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168854:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fecc00/0xd718aadfd785e438 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168868:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e45b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168874:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e45b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168880:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e45b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168885:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127481.168888:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e45b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168894:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e45b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168901:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9346a69cb300) 00010000:00010000:3.0:1789127481.168904:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127481.168906:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e45b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168912:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785e45b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168926:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e52d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168932:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e52d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168944:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e52d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168949:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6e00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127481.168951:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e52d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168957:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e52d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168965:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:3.0:1789127481.168968:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127481.168970:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e52d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168976:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6e00/0xd718aadfd785e52d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168989:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.168996:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.169002:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.169007:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127481.169010:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.169026:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789127481.169119:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1789127481.169153:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1789127481.169176:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9346b1b1b0c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1789127481.169181:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9346aecaf700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9346b1b1bf00 00000020:00080000:2.0:1789127481.169184:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9346aecafa00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff934587e8d600 00000100:00100000:1.0:1789127481.169385:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789553792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789127481.169455:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127481.169500:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127481.169523:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789553664:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789127481.169547:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127481.169577:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789553792 00000100:00100000:1.0:1789127481.169583:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789553792 00000100:00100000:1.0:1789127481.169626:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789553664 00000100:00100000:1.0:1789127481.169630:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789553664 00000100:00100000:1.0:1789127481.169650:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789127481.169659:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3650:x1876035789553792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1789127481.169774:0:10363:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789127481.169778:0:10363:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789127480 00002000:00010000:1.0:1789127481.169781:0:10363:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789127481.169783:0:10363:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789127480 -> 1789127480 00002000:00010000:1.0:1789127481.169785:0:10363:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1789127481.169823:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3650:x1876035789553792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 165us (367us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789127481.169830:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789127481.169846:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789127481.169861:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3652:x1876035789553664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789127481.169877:0:10363:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1789127481.169893:0:10363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785e614 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.169911:0:10363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b383b30/0xd718aadfd785e3c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffef0 expref: 12 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.169920:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1789127481.169924:0:10363:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789127481.169928:0:10363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785e614 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.169952:0:10363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b383b30/0xd718aadfd785e3c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffef0 expref: 12 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.169966:0:10363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b383b30/0xd718aadfd785e3c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffef0 expref: 12 pid: 10363 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127481.169978:0:10363:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10363:1876035789553920:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789127481.170051:0:10363:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1b1bb40 going to sleep for 11 seconds 00000100:00080000:1.0:1789127481.170064:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789127481.170093:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff934588e5c000/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789127481.170099:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789553792:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1789127481.170271:0:6501:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1789127481.170304:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff934690351e40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1789127481.170308:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff934687b27300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9346a9c0dd80 00000020:00080000:2.0:1789127481.170321:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff934687b27700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9346bebc6c00 00000020:00080000:2.0:1789127481.170346:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1789127481.170383:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789127481.170458:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:12755:x1876035771673856:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 3802us (4077us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127481.170467:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 244 00010000:00010000:3.0:1789127481.171669:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042e00) 00010000:00010000:3.0:1789127481.171676:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789127481.171683:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5ea lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.171692:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fed800/0xd718aadfd785e5ea lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127481.172870:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789554048:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789127481.172937:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127481.172986:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789554048 00000100:00100000:3.0:1789127481.172994:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789554048 00000100:00100000:3.0:1789127481.173493:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789127481.173504:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346bf8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3651:x1876035789554048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789127481.173582:0:8755:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1789127481.173624:0:8755:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3eb36, atime: 0x6aa3eb36, ctime: 0x6aa3eb36, blocks: 0x8 00010000:00010000:3.0:1789127481.173631:0:8755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e61b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.173646:0:8755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1789127481.173650:0:8755:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127481.173657:0:8755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.173672:0:8755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.173699:0:8755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e61b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.173804:0:8755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e61b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.173865:0:8755:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789127481.174076:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346bf8b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3651:x1876035789554048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 573us (1137us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789127481.174085:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1789127481.174122:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1789127481.174152:0:3651:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff934588e18b40/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789127481.174159:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e18b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789554048:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789127481.174261:0:10363:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5fc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:10363:1876035789553920:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127481.174282:0:10363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785e614 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127481.176929:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127481.177306:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771673984 00000100:00100000:3.0:1789127481.177316:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771673984 00010000:00010000:3.0:1789127481.177355:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b383b30/0xd718aadfd785e3c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffef0 expref: 13 pid: 10363 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127481.177400:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:3.0:1789127481.177410:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+13:2402:x1876035771673984:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127481.177424:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127481.177429:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b383b30/0xd718aadfd785e3c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffef0 expref: 13 pid: 10363 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.177460:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b383b30/0xd718aadfd785e3c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffef0 expref: 13 pid: 10363 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.177497:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b383b30/0xd718aadfd785e3c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffef0 expref: 13 pid: 10363 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.177544:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127481.177549:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127481.177555:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785e614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.177566:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785e614 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.177592:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127481.177638:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+12:2402:x1876035771673984:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 230us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127481.177646:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 115 00010000:00010000:2.0:1789127481.178127:0:10363:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785e614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.178138:0:10363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785e614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.178147:0:10363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785e614 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.178156:0:10363:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785e614 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.178486:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127481.178495:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e61b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.178503:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b800 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127481.178524:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e61b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.178534:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e61b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.178550:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e61b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.178557:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078e901e9/0xd718aadfd785e61b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.178579:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127481.178583:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785e614 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.178600:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c200 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127481.178603:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785e614 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.178610:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785e614 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.178622:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785e614 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.178630:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127481.178632:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127481.178634:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127481.179913:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127481.180006:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771674112 00000100:00100000:3.0:1789127481.180015:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771674112 00000100:00100000:3.0:1789127481.180078:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 76 00000100:00100000:3.0:1789127481.180088:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+12:2400:x1876035771674112:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1789127481.182314:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1789127481.182327:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:3.0:1789127481.182498:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2400:x1876035771674112:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 2407us (2587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127481.182558:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 76 00010000:00010000:2.0:1789127481.182848:0:10363:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789127481.182848:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127481.182857:0:10363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000eb83713/0xd718aadfd785e614 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127481.183235:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3652:x1876035789553664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13374us (13685us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1789127481.183244:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789127481.183949:0:3652:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1789127481.183956:0:3652:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:1.0:1789127481.183988:0:3652:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff934588e5c000, transno 4294967322 00000100:00100000:1.0:1789127481.184012:0:3652:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff934588e5c780 x1876035789553664/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789127497 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1789127481.184024:0:3652:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff934588e5c780/2, rc 0, transno 4294967323 00000100:00100000:1.0:1789127481.184029:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789553664:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789127481.185626:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127481.185723:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771674368 00000100:00100000:0.0:1789127481.185732:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771674368 00000100:00100000:0.0:1789127481.185774:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 245 00000100:00100000:0.0:1789127481.185784:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:12755:x1876035771674368:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789127481.185831:0:6523:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127481.185856:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e5ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff8a expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.185873:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042e00) 00010000:00010000:0.0:1789127481.185878:0:6523:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127481.185919:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e622 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.185932:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e622 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.185942:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e622 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127481.186097:0:6523:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fcd30798 reply state 00000000b5fe87a8 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e622 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.186108:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e622 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.186114:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042e00) 00010000:00010000:0.0:1789127481.186116:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127481.186118:0:6523:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127481.186216:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:12755:x1876035771674368:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 433us (597us total) trans 4294967509 rc 0/0 00000100:00100000:0.0:1789127481.186224:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 245 00000100:00100000:1.0:1789127481.188606:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127481.188851:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771674496 00000100:00100000:3.0:1789127481.188862:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771674496 00000100:00100000:3.0:1789127481.188913:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:3.0:1789127481.188923:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771674496:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789127481.189064:0:8755:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789127481.189068:0:8755:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789127480 -> 1789127479 00002000:00010000:3.0:1789127481.189070:0:8755:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789127478 00002000:00010000:3.0:1789127481.189072:0:8755:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789127480 -> 1789127479 00002000:00010000:3.0:1789127481.189074:0:8755:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789127481.189131:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2402:x1876035771674496:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 208us (532us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789127481.189138:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 77 00000100:00100000:2.0:1789127481.191184:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127481.191270:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771674752 00000100:00100000:0.0:1789127481.191279:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771674752 00000100:00100000:0.0:1789127481.191364:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 246 00000100:00100000:0.0:1789127481.191374:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:12755:x1876035771674752:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789127481.191438:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.191453:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e5e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff7c expref: 22 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.191474:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.191553:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff7c expref: 22 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.191566:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e5e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff7c expref: 22 pid: 9447 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127481.191581:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e19a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789554176:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127481.191646:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127481.194913:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127481.195022:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e19a40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6522:1876035789554176:192.168.206.48@tcp:104: 00010000:00010000:3.0:1789127481.195057:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127481.195857:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771674880 00000100:00100000:2.0:1789127481.195866:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771674880 00010000:00010000:2.0:1789127481.195904:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e5e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff7c expref: 23 pid: 9447 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127481.195944:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:2.0:1789127481.195954:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+23:2402:x1876035771674880:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127481.195968:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127481.195974:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e5e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff7c expref: 23 pid: 9447 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.195986:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e5e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff7c expref: 23 pid: 9447 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.196008:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785e5e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff7c expref: 23 pid: 9447 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.196023:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042e00) 00010000:00010000:2.0:1789127481.196029:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.196048:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.196056:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.196087:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127481.196147:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:2402:x1876035771674880:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 195us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127481.196167:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 116 00010000:00010000:0.0:1789127481.196233:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.196239:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.196274:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.196281:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.196286:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.196292:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127481.196295:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.196309:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.196318:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042e00) 00010000:00010000:0.0:1789127481.196321:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789127481.196324:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.196330:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e629 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127481.196384:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e703c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:12755:x1876035771674752:12345-192.168.206.48@tcp:55:lhsmtool_posix.0 Request processed in 5011us (5207us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789127481.196392:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 246 00000100:00100000:1.0:1789127481.198907:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127481.199016:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771675008 00000100:00100000:0.0:1789127481.199025:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771675008 00000100:00100000:0.0:1789127481.199088:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:0.0:1789127481.199098:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2401:x1876035771675008:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789127481.199141:0:8438:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000002fe4d04/0xd718aadfd785e630 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.199159:0:8438:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dc5a1929/0xd718aadfd785e60d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff98 expref: 8 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.199167:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127481.199171:0:8438:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127481.199176:0:8438:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002fe4d04/0xd718aadfd785e630 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.199222:0:8438:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dc5a1929/0xd718aadfd785e60d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff98 expref: 8 pid: 8755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.199236:0:8438:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dc5a1929/0xd718aadfd785e60d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff98 expref: 8 pid: 8755 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127481.199250:0:8438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e192c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1876035789554304:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127481.199315:0:8438:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127481.213007:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127481.213132:0:8438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e192c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8438:1876035789554304:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127481.213160:0:8438:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000002fe4d04/0xd718aadfd785e630 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127481.213167:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771675136 00000100:00100000:3.0:1789127481.213173:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771675136 00010000:00010000:3.0:1789127481.213211:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dc5a1929/0xd718aadfd785e60d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff98 expref: 9 pid: 8755 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127481.213252:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:3.0:1789127481.213262:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+9:2401:x1876035771675136:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127481.213277:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127481.213311:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dc5a1929/0xd718aadfd785e60d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff98 expref: 9 pid: 8755 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.213324:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dc5a1929/0xd718aadfd785e60d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff98 expref: 9 pid: 8755 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.213346:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dc5a1929/0xd718aadfd785e60d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff98 expref: 9 pid: 8755 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.213362:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127481.213366:0:6508:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789127481.213372:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000002fe4d04/0xd718aadfd785e630 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.213382:0:6508:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002fe4d04/0xd718aadfd785e630 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.213414:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127481.213484:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2401:x1876035771675136:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 213us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127481.213493:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 117 00010000:00010000:0.0:1789127481.213831:0:8438:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000002fe4d04/0xd718aadfd785e630 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.213841:0:8438:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002fe4d04/0xd718aadfd785e630 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.213861:0:8438:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000002fe4d04/0xd718aadfd785e630 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.213869:0:8438:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002fe4d04/0xd718aadfd785e630 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.213889:0:8438:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002fe4d04/0xd718aadfd785e630 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.213896:0:8438:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec800 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127481.213899:0:8438:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002fe4d04/0xd718aadfd785e630 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.213908:0:8438:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002fe4d04/0xd718aadfd785e630 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.213920:0:8438:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002fe4d04/0xd718aadfd785e630 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.213927:0:8438:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002fe4d04/0xd718aadfd785e630 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8438 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127481.213991:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771675008:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 14894us (15091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127481.214000:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 78 00000100:00100000:1.0:1789127481.229625:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127481.229781:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771675392 00000100:00100000:0.0:1789127481.229790:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771675392 00000100:00100000:0.0:1789127481.229847:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 247 00000100:00100000:0.0:1789127481.229857:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:12755:x1876035771675392:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789127481.229946:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.229977:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e526 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff44 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.229987:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.230023:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff44 expref: 21 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.230050:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff44 expref: 21 pid: 6522 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127481.230066:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e192c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789554432:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127481.230466:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127481.232143:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e192c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789554432:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127481.232169:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127481.233404:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127481.233485:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771675520 00000100:00100000:2.0:1789127481.233493:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771675520 00010000:00010000:2.0:1789127481.233563:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff44 expref: 22 pid: 6522 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127481.233610:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:2.0:1789127481.233620:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:2402:x1876035771675520:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127481.233632:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127481.233639:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e526 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff44 expref: 22 pid: 6522 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.233651:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e526 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff44 expref: 22 pid: 6522 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.233682:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785e526 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff44 expref: 22 pid: 6522 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.233697:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:2.0:1789127481.233703:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e588 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff67 expref: 21 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.233713:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.233720:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.233744:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.233763:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127481.233818:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:2402:x1876035771675520:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 199us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127481.233825:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 118 00010000:00010000:0.0:1789127481.234428:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.234438:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.234647:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.234660:0:6523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff83 expref: 21 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.234677:0:6523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.234707:0:6523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff83 expref: 21 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.234721:0:6523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff83 expref: 21 pid: 9447 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127481.234734:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e192c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789554560:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127481.234799:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127481.244219:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127481.244442:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e192c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789554560:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127481.244468:0:6523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127481.244583:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771675648 00000100:00100000:3.0:1789127481.244599:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771675648 00010000:00010000:3.0:1789127481.244635:0:6508:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff83 expref: 22 pid: 9447 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127481.244669:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 119 00000100:00100000:3.0:1789127481.244679:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:2402:x1876035771675648:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127481.244717:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127481.244725:0:6508:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff83 expref: 22 pid: 9447 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.244738:0:6508:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff83 expref: 22 pid: 9447 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.244760:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e5f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff83 expref: 22 pid: 9447 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.244777:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042e00) 00010000:00010000:3.0:1789127481.244782:0:6508:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.244792:0:6508:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.244799:0:6508:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.244826:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127481.244884:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:2402:x1876035771675648:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 206us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127481.244891:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 119 00010000:00010000:0.0:1789127481.245146:0:6523:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.245154:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789127481.245257:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1789127481.245360:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1789127481.245390:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1789127481.245467:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e192c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1876035789554688:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789127481.245602:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127481.245637:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789554688 00000100:00100000:0.0:1789127481.245652:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789554688 00000100:00100000:0.0:1789127481.245686:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789127481.245694:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1876035789554688:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789127481.245760:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6523:x1876035789554688:12345-0@lo:1000:mdt00_001.0 Request processed in 67us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127481.245766:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789127481.245788:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c0dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127481.245809:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e192c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1876035789554688:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789127481.245917:0:6523:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1789127481.245954:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e192c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1876035789554816:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789127481.245978:0:6523:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127481.246000:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789554816 00000100:00100000:0.0:1789127481.246003:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789554816 00000100:00100000:0.0:1789127481.246024:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789127481.246030:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6523:x1876035789554816:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789127481.246123:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6523:x1876035789554816:12345-0@lo:1000:mdt00_001.0 Request processed in 92us (143us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789127481.246129:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789127481.246146:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684afd9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127481.246161:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e192c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6523:1876035789554816:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789127481.246185:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246194:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246200:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246213:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127481.246218:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246226:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246238:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042e00) 00010000:00010000:0.0:1789127481.246241:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127481.246245:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246251:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e63e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246273:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e581 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246279:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e581 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246285:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e581 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246289:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127481.246292:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e581 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246298:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e581 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246318:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:0.0:1789127481.246320:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789127481.246326:0:6523:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e588 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff67 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246336:0:6523:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e588 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff67 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246344:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e588 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff67 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.246365:0:6523:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e588 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff67 expref: 24 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127481.246375:0:6523:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e19680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789554944:192.168.206.48@tcp:105: 00000100:00100000:0.0:1789127481.246415:0:6523:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684afd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127481.252066:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127481.252476:0:6523:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e19680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6523:1876035789554944:192.168.206.48@tcp:105: 00010000:00010000:0.0:1789127481.252503:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e581 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252549:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e581 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252583:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e645 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252606:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e645 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252627:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e645 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252637:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e645 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252642:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e645 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252649:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e645 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252655:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fede00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127481.252658:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e645 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252665:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e645 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252676:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:0.0:1789127481.252679:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127481.252685:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e645 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252690:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e645 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252700:0:6523:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252706:0:6523:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252733:0:6523:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252738:0:6523:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127481.252740:0:6523:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252746:0:6523:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252753:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:0.0:1789127481.252756:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789127481.252758:0:6523:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127481.252763:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec800/0xd718aadfd785e637 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127481.252944:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:12755:x1876035771675392:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 23087us (23327us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1789127481.252955:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 247 00000020:00080000:0.0:1789127481.252961:0:6523:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789127481.253335:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789127481.253340:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127481.253854:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789127481.253862:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789127481.254156:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771675776 00000100:00100000:1.0:1789127481.254163:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771675776 00000100:00100000:1.0:1789127481.254216:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:1.0:1789127481.254226:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:12754:x1876035771675776:12345-192.168.206.48@tcp:49:lfs.0 00000100:00100000:1.0:1789127481.254323:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:12754:x1876035771675776:12345-192.168.206.48@tcp:49:lfs.0 Request processed in 99us (2268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127481.254331:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:2.0:1789127481.260673:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127481.260800:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771676032 00000100:00100000:1.0:1789127481.260821:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771676032 00000100:00100000:1.0:1789127481.260876:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:1.0:1789127481.260885:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1bab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+24:12755:x1876035771676032:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789127481.261448:0:6526:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789127481.261477:0:6526:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:1.0:1789127481.261555:0:6526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e64c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.261570:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e64c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.261582:0:6526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e64c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.261590:0:6526:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e64c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.261597:0:6526:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e64c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.261603:0:6526:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e64c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.261666:0:6526:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789127481.261854:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1bab050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+26:12755:x1876035771676032:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 969us (1190us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789127481.261864:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00000020:00080000:1.0:1789127481.261869:0:6526:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789127481.262243:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127481.262259:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e64c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.262266:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127481.262270:0:8454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e64c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.262277:0:8454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e64c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.262289:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042e00) 00010000:00010000:3.0:1789127481.262292:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789127481.262297:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e64c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.262302:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e64c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6526 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.262315:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127481.262317:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127481.262318:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127481.271830:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127481.281643:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127481.281758:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771676288 00000100:00100000:1.0:1789127481.281767:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771676288 00000100:00100000:1.0:1789127481.281826:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 248 00000100:00100000:1.0:1789127481.281848:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+26:12754:x1876035771676288:12345-192.168.206.48@tcp:58:lfs.0 00000040:00080000:1.0:1789127481.282004:0:9447:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789127481.282097:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+26:12754:x1876035771676288:12345-192.168.206.48@tcp:58:lfs.0 Request processed in 250us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127481.282105:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 248 00000100:00100000:0.0:1789127481.321087:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127481.321223:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771676416 00000100:00100000:1.0:1789127481.321232:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771676416 00000100:00100000:1.0:1789127481.321289:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 249 00000100:00100000:1.0:1789127481.321299:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+26:12757:x1876035771676416:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1789127481.321321:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127481.321341:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e653 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effff9f expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.321405:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e65a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.321419:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e65a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.321430:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e65a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.321443:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e661 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.321449:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.321455:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.321592:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e668 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.321604:0:6524:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff60 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.321611:0:6524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e668 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.321642:0:6524:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff60 expref: 27 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127481.321656:0:6524:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff60 expref: 27 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127481.321669:0:6524:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789555072:192.168.206.48@tcp:104: 00000100:00100000:1.0:1789127481.321761:0:6524:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1b1bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127481.324759:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127481.324841:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771676672 00000100:00100000:3.0:1789127481.324851:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771676672 00000100:00100000:3.0:1789127481.324911:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:3.0:1789127481.324920:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:6170:x1876035771676672:12345-192.168.206.48@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789127481.325145:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e712c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:6170:x1876035771676672:12345-192.168.206.48@tcp:35:ldlm_bl.0 Request processed in 225us (393us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1789127481.325153:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:1.0:1789127481.326104:0:6524:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6524:1876035789555072:192.168.206.48@tcp:104: 00010000:00010000:1.0:1789127481.326127:0:6524:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e668 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127481.328464:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127481.328585:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771676800 00000100:00100000:3.0:1789127481.328594:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771676800 00010000:00010000:3.0:1789127481.328644:0:6509:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff60 expref: 29 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127481.328685:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 120 00000100:00100000:3.0:1789127481.328694:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:2401:x1876035771676800:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127481.328719:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127481.328726:0:6509:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff60 expref: 29 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.328739:0:6509:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff60 expref: 29 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.328762:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e573 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff60 expref: 29 pid: 6523 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.328777:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:3.0:1789127481.328782:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e668 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.328792:0:6509:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.328800:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e668 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127481.328834:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127481.328892:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e72d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:2401:x1876035771676800:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 198us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127481.328899:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 120 00010000:00010000:2.0:1789127481.329240:0:6524:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329249:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127481.329300:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789127481.329305:0:6524:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127481.329324:0:6524:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329336:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e668 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329345:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e65a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329352:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e65a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329364:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e65a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329370:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127481.329373:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e65a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329380:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e65a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329390:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:2.0:1789127481.329393:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127481.329397:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e65a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329403:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785e65a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329414:0:6524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e661 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329420:0:6524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e661 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329427:0:6524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329432:0:6524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127481.329435:0:6524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e661 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329449:0:6524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e661 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329457:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff93468b042200) 00010000:00010000:2.0:1789127481.329459:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127481.329461:0:6524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e661 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329466:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d800/0xd718aadfd785e661 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329499:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858cc00/0xd718aadfd785e653 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff9f expref: 28 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329565:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e668 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff9f expref: 27 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127481.329573:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:2.0:1789127481.329576:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127481.329579:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858da00, rc 0) 00000100:00100000:2.0:1789127481.329611:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12757:x1876035771676416:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 8314us (8531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127481.329619:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 249 00000040:00080000:1.0:1789127481.849288:0:14505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789127481.855683:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127481.855748:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771676928 00000100:00100000:1.0:1789127481.855757:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771676928 00000100:00100000:1.0:1789127481.855814:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 456 00000100:00100000:1.0:1789127481.855823:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771676928:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127481.855895:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771676928:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 72us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127481.855911:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 456 00000100:00100000:3.0:1789127481.867772:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127481.867810:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127481.867836:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127481.867870:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127481.867899:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771677056 00000100:00100000:3.0:1789127481.867907:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771677056 00000100:00100000:3.0:1789127481.867961:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771677312 00000100:00100000:3.0:1789127481.867965:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771677312 00000100:00100000:3.0:1789127481.867981:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771677440 00000100:00100000:3.0:1789127481.867983:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771677440 00000100:00100000:3.0:1789127481.867998:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 366 00000100:00100000:3.0:1789127481.868007:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771677056:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127481.868088:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2402:x1876035771677056:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 81us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127481.868095:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 366 00000100:00100000:3.0:1789127481.868110:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 367 00000100:00100000:3.0:1789127481.868116:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771677312:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127481.868140:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2402:x1876035771677312:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127481.868146:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 367 00000100:00100000:3.0:1789127481.868157:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 368 00000100:00100000:3.0:1789127481.868163:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771677440:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127481.868185:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771677440:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 22us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127481.868191:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 368 00000100:00100000:3.0:1789127481.868209:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771677184 00000100:00100000:3.0:1789127481.868222:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771677184 00000100:00100000:3.0:1789127481.868251:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 141 00000100:00100000:3.0:1789127481.868258:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771677184:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127481.868284:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebde00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771677184:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 28us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127481.868290:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 141 00000100:00080000:3.0:1789127481.868308:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127481.868312:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127481.868314:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1789127482.154791:0:15514:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789127482.154800:0:15514:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789127482.154828:0:15514:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789127482.154834:0:15514:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1789127482.295684:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789127482.295694:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127482.295719:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789127482.295726:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789127482.295844:0:14502:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14502:1876035789555200:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789127482.295948:0:14502:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346c1f63e40 going to sleep for 11 seconds 00010000:00010000:1.0:1789127482.297714:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127482.298253:0:14502:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14502:1876035789555200:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789127482.302232:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127482.302315:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771677568 00000100:00100000:0.0:1789127482.302330:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771677568 00000100:00100000:0.0:1789127482.302381:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 250 00000100:00100000:0.0:1789127482.302392:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12769:x1876035771677568:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789127482.302426:0:6522:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789127482.302551:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12769:x1876035771677568:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 161us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127482.302560:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 250 00000100:00100000:2.0:1789127482.333429:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127482.333499:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771677824 00000100:00100000:3.0:1789127482.333686:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771677824 00000100:00100000:3.0:1789127482.333750:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 251 00000100:00100000:3.0:1789127482.333760:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+27:12769:x1876035771677824:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127482.333780:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127482.333800:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e66f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effffa6 expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127482.335805:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e676 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127482.335826:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127482.335851:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e676 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127482.335867:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789127482.335998:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501aa00/0xd718aadfd785e66f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffa6 expref: 30 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127482.336017:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e676 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffa6 expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127482.336027:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:3.0:1789127482.336041:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127482.336044:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b200, rc 0) 00000100:00100000:3.0:1789127482.336151:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e721c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:12769:x1876035771677824:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 2392us (2728us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1789127482.336160:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 251 00000100:00100000:3.0:1789127482.350760:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127482.350837:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127482.351038:0:6508:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771678208 00000100:00100000:0.0:1789127482.351048:0:6508:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771678208 00000100:00100000:0.0:1789127482.351326:0:6508:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:0.0:1789127482.351338:0:6508:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b9debc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:2401:x1876035771678208:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127482.351352:0:6508:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127482.351397:0:6508:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b200/0xd718aadfd785e676 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffa6 expref: 29 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127482.351431:0:6508:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:0.0:1789127482.351436:0:6508:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127482.351482:0:6508:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b9debc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:2401:x1876035771678208:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 147us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127482.351491:0:6508:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:2.0:1789127482.351640:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771678080 00000100:00100000:2.0:1789127482.351661:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771678080 00000100:00100000:2.0:1789127482.351702:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 252 00000100:00100000:2.0:1789127482.351722:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+28:12769:x1876035771678080:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789127482.351794:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e684 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127482.351808:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127482.351820:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127482.351967:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e684 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127482.351974:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e684 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127482.351981:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e684 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127482.351987:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127482.351991:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e684 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127482.351997:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e684 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127482.352006:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:2.0:1789127482.352009:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789127482.352013:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e684 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127482.352018:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d6000/0xd718aadfd785e684 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127482.352131:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:12769:x1876035771678080:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 410us (1293us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1789127482.352137:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 252 00000040:00080000:3.0:1789127482.352561:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789127482.352565:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789127482.354916:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789127482.354930:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789127482.377732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127482.377767:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771678464 00000100:00100000:3.0:1789127482.377777:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771678464 00000100:00100000:3.0:1789127482.377825:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:3.0:1789127482.377833:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+29:12769:x1876035771678464:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789127482.378042:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e75a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+30:12769:x1876035771678464:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 197us (306us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1789127482.378049:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00010000:00010000:3.0:1789127483.320904:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127483.704643:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127483.704666:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789555328:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127483.704751:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127483.704819:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789555328 00000100:00100000:1.0:1789127483.704827:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789555328 00000100:00100000:1.0:1789127483.704871:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789127483.704882:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789555328:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127483.704915:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789127483.704961:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789555328:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127483.704968:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789127483.705015:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789555328:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127484.238040:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789555584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127484.238106:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238153:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789556096:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.238178:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238199:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789556608:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.238234:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238258:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346929221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789557120:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.238280:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238306:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789127484.238312:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789555712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127484.238335:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238353:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346a5388f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789556224:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.238372:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238390:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789556736:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.238409:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238425:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346929203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789557248:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.238444:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238472:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e1ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789555840:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.238499:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238537:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789556352:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.238558:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238575:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346929212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789556864:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.238595:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238611:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692921e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789557376:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.238631:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238649:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789127484.238655:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789555456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127484.238675:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238691:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789555968:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.238721:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238739:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789556480:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.238759:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238770:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692921680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789556992:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.238801:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.238824:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789555584 00000100:00100000:0.0:1789127484.238830:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789555584 00000100:00100000:0.0:1789127484.238876:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789555712 00000100:00100000:0.0:1789127484.238879:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789555712 00000100:00100000:0.0:1789127484.238897:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789127484.238905:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692922580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789555584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789127484.238933:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127484.238973:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692922580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789555584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.238981:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789127484.238997:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789127484.239003:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1876035789555712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127484.239012:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127484.239048:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1876035789555712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.239054:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789127484.239074:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789556096 00000100:00100000:0.0:1789127484.239078:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789556096 00000100:00100000:0.0:1789127484.239094:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789556352 00000100:00100000:0.0:1789127484.239096:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789556352 00000100:00100000:0.0:1789127484.239107:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789555456 00000100:00100000:0.0:1789127484.239109:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789555456 00000100:00100000:0.0:1789127484.239131:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789127484.239137:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692923c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789556096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.239171:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692923c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789556096:12345-0@lo:400:kworker.0 Request processed in 34us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.239178:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789127484.239191:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789127484.239197:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1876035789556352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.239230:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3652:x1876035789556352:12345-0@lo:400:kworker.0 Request processed in 33us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.239235:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789127484.239246:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789127484.239252:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789555456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789127484.239269:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127484.239296:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789555456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 44us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.239302:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789127484.239319:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789556608 00000100:00100000:0.0:1789127484.239322:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789556608 00000100:00100000:0.0:1789127484.239341:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789557120 00000100:00100000:0.0:1789127484.239344:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789557120 00000100:00100000:0.0:1789127484.239354:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789556224 00000100:00100000:0.0:1789127484.239357:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789556224 00000100:00100000:0.0:1789127484.239364:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789555968 00000100:00100000:0.0:1789127484.239366:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789555968 00000100:00100000:0.0:1789127484.239376:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789556480 00000100:00100000:0.0:1789127484.239377:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789556480 00000100:00100000:0.0:1789127484.239388:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789556992 00000100:00100000:0.0:1789127484.239391:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789556992 00000100:00100000:0.0:1789127484.239403:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789127484.239415:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789556608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.239447:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692920000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789556608:12345-0@lo:400:kworker.0 Request processed in 33us (1212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.239453:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1789127484.239466:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789127484.239471:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692920f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789557120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.239500:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692920f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789557120:12345-0@lo:400:kworker.0 Request processed in 28us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.239505:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1789127484.239539:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789127484.239545:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789556224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.239574:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789556224:12345-0@lo:400:kworker.0 Request processed in 30us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.239579:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1789127484.239588:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789127484.239594:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789555968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.239618:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789555968:12345-0@lo:400:kworker.0 Request processed in 25us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.239623:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1789127484.239633:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789127484.239638:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789556480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.239661:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789556480:12345-0@lo:400:kworker.0 Request processed in 23us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.239666:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:0.0:1789127484.239677:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789127484.239689:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789556992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.239717:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3652:x1876035789556992:12345-0@lo:400:kworker.0 Request processed in 28us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.239722:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789127484.239744:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789556736 00000100:00100000:0.0:1789127484.239748:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789556736 00000100:00100000:0.0:1789127484.239774:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789557248 00000100:00100000:0.0:1789127484.239777:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789557248 00000100:00100000:0.0:1789127484.239789:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789556864 00000100:00100000:0.0:1789127484.239791:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789556864 00000100:00100000:0.0:1789127484.239801:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789557376 00000100:00100000:0.0:1789127484.239804:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789557376 00000100:00100000:0.0:1789127484.239813:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789127484.239819:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789556736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.239849:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789556736:12345-0@lo:400:kworker.0 Request processed in 30us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.239855:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789127484.239866:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789127484.239872:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789557248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.239896:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789557248:12345-0@lo:400:kworker.0 Request processed in 24us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.239900:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789127484.239911:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789127484.239916:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1876035789556864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.239941:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72aa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1876035789556864:12345-0@lo:400:kworker.0 Request processed in 26us (1346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.239946:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789127484.239964:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789127484.239970:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1876035789557376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.240000:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3652:x1876035789557376:12345-0@lo:400:kworker.0 Request processed in 30us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.240006:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789127484.240040:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789555840 00000100:00100000:0.0:1789127484.240043:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789555840 00000100:00100000:0.0:1789127484.240070:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:0.0:1789127484.240076:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789555840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.240105:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1845050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789555840:12345-0@lo:400:kworker.0 Request processed in 29us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.240111:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00080000:0.0:1789127484.240149:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127484.240154:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127484.240156:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127484.240158:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127484.240195:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789555712:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127484.240207:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346a5388f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789556224:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.240217:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789556736:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.240227:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346929203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789557248:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.240238:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e18780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789555584:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127484.240247:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789556096:0@lo:400:kworker.0 00010000:00080000:0.0:1789127484.240258:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692921a40 x1876035789556608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127484.240279:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692921a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789556608:0@lo:400:kworker.0 00010000:00080000:0.0:1789127484.240292:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346929221c0 x1876035789557120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127484.240299:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346929221c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789557120:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.240347:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789555456:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127484.240356:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e18f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789555968:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.240365:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692923480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789556480:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.240373:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692921680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3652:1876035789556992:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.240380:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e1ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789555840:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.240387:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789556352:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.240396:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346929212c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789556864:0@lo:400:kworker.0 00000100:00100000:0.0:1789127484.240404:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692921e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789557376:0@lo:400:kworker.0 00000040:00080000:2.0:1789127484.250439:0:15565:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127484.250448:0:15565:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127484.250478:0:15565:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789127484.250483:0:15565:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789127484.349690:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127484.445948:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127484.458961:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771678720 00000100:00100000:0.0:1789127484.458976:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771678720 00000100:00100000:0.0:1789127484.459099:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 253 00000100:00100000:0.0:1789127484.459110:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+30:12789:x1876035771678720:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127484.459133:0:6524:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127484.459167:0:6524:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e68b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effffad expref: -99 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127484.459296:0:6524:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e692 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127484.459310:0:6524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e692 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127484.459322:0:6524:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e692 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6524 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127484.459342:0:6524:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789127484.459453:0:6524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e68b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffad expref: 33 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127484.459481:0:6524:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e692 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffad expref: 32 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127484.459490:0:6524:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:0.0:1789127484.459492:0:6524:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789127484.459496:0:6524:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec600, rc 0) 00000100:00100000:0.0:1789127484.459573:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+32:12789:x1876035771678720:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 466us (13634us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789127484.459581:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 253 00000100:00100000:0.0:1789127484.465703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127484.465735:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771678848 00000100:00100000:0.0:1789127484.465743:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771678848 00000100:00100000:0.0:1789127484.465791:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 254 00000100:00100000:0.0:1789127484.465802:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+32:12789:x1876035771678848:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:0.0:1789127484.465874:0:9447:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e6a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127484.465890:0:9447:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127484.465900:0:9447:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127484.465929:0:9447:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e6a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127484.465936:0:9447:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e6a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127484.465943:0:9447:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127484.465949:0:9447:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127484.465953:0:9447:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e6a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127484.465960:0:9447:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e6a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127484.465969:0:9447:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:0.0:1789127484.465972:0:9447:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127484.465976:0:9447:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e6a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127484.465982:0:9447:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e6a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9447 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127484.466978:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+32:12789:x1876035771678848:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 1173us (1278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127484.466988:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 254 00000100:00080000:1.0:1789127484.471686:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127484.561620:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127484.562616:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771678976 00000100:00100000:1.0:1789127484.562627:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771678976 00000100:00100000:1.0:1789127484.562709:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00100000:1.0:1789127484.562720:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2402:x1876035771678976:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:1.0:1789127484.562741:0:8439:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127484.562760:0:8439:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e53e0f6/0xd718aadfd785e6a7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effffb4 expref: -99 pid: 8439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127484.562802:0:8439:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa3eb37, atime: 0x6aa3eb36, ctime: 0x6aa3eb37, blocks: 0x8 00010000:00010000:1.0:1789127484.562823:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=445s v=(0 0) 00010000:00010000:1.0:1789127484.562827:0:8439:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127484.562837:0:8439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e53e0f6/0xd718aadfd785e6a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffb4 expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127484.562855:0:8439:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007e53e0f6/0xd718aadfd785e6a7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffb4 expref: 8 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127484.562868:0:8439:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858ce00, rc 0) 00000100:00100000:1.0:1789127484.562946:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2402:x1876035771678976:12345-192.168.206.48@tcp:101:cat.0 Request processed in 229us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127484.562954:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 79 00000100:00080000:0.0:1789127484.564186:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127484.579901:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127484.580159:0:8445:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771679104 00000100:00100000:2.0:1789127484.580168:0:8445:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771679104 00002000:00100000:2.0:1789127484.580216:0:8445:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff934588e75e00 x1876035771679104/t0(0) o3->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:220/0 lens 488/0 e 0 to 0 dl 1789127495 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789127484.580227:0:8445:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff934588e75e00 with x1876035771679104 ext(0->4095) 00002000:00010000:2.0:1789127484.580233:0:8445:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff934588e75e00 00000100:00100000:2.0:1789127484.580266:0:8445:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1789127484.580276:0:8445:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2399:x1876035771679104:12345-192.168.206.48@tcp:3:cat.0 00000100:00100000:2.0:1789127484.580424:0:8445:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e75e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+8:2399:x1876035771679104:12345-192.168.206.48@tcp:3:cat.0 Request processed in 149us (540us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789127484.580433:0:8445:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00002000:00100000:2.0:1789127484.580439:0:8445:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff934588e75e00 x1876035771679104/t0(0) o3->2eecd753-97f2-4dc9-9442-17e5ef8fda22@192.168.206.48@tcp:220/0 lens 488/4536 e 0 to 0 dl 1789127495 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789127484.580446:0:8445:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff934588e75e00 with x1876035771679104 ext(0->4095) 00002000:00010000:2.0:1789127484.580449:0:8445:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff934588e75e00 00000100:00100000:3.0:1789127484.729460:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127484.729483:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789557504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127484.729563:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127484.729615:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789557632:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127484.729646:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127484.729668:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789557504 00000100:00100000:3.0:1789127484.729675:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789557504 00000100:00100000:3.0:1789127484.729720:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789557632 00000100:00100000:3.0:1789127484.729723:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789557632 00000100:00100000:1.0:1789127484.739801:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789127484.739826:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789557504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127484.739860:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789127484.740176:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e74780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789557504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 361us (10612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127484.740185:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789127484.740208:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789127484.740217:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692921e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1876035789557632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127484.740228:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789127484.740264:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692921e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3650:x1876035789557632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (10617us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127484.740285:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789127484.740373:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789557632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127484.746541:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789557504:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789127485.369685:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789127485.764234:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1789127485.764260:0:9519:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:3.0:1789127486.392415:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789127486.780406:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1789127486.780442:0:6501:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff934684afd780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789127486.780447:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff934685141800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff934684afd300 00000020:00080000:0.0:1789127486.780451:0:6501:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff934685141400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff93458855f000 00000020:00080000:0.0:1789127486.780466:0:6501:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:2.0:1789127486.780569:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e622 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127486.780587:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e622 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127486.780595:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e622 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127486.780601:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127486.780606:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e622 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127486.780614:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e622 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127486.780629:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff93468b042e00) 00010000:00010000:2.0:1789127486.780632:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127486.780637:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e622 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127486.780643:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec400/0xd718aadfd785e622 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789127486.780672:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1789127486.780743:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1789127486.781751:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:3.0:1789127486.781761:0:8433:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:2.0:1789127486.973825:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127486.973864:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127486.973897:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127486.973926:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127486.973944:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127486.973957:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127486.973974:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127486.974033:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771679488 00000100:00100000:2.0:1789127486.974041:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771679488 00000100:00100000:2.0:1789127486.974091:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771680000 00000100:00100000:2.0:1789127486.974095:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771680000 00000100:00100000:2.0:1789127486.974109:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771679360 00000100:00100000:2.0:1789127486.974111:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771679360 00000100:00100000:2.0:1789127486.974122:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771679872 00000100:00100000:2.0:1789127486.974124:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771679872 00000100:00100000:2.0:1789127486.974140:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 375 00000100:00100000:2.0:1789127486.974150:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771679488:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127486.974227:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e730c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771679488:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 78us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127486.974234:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 375 00000100:00100000:2.0:1789127486.974251:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 376 00000100:00100000:2.0:1789127486.974257:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771680000:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127486.974279:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771680000:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 22us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127486.974285:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 376 00000100:00100000:2.0:1789127486.974296:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 377 00000100:00100000:2.0:1789127486.974302:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:2400:x1876035771679360:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127486.974327:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e72580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:2400:x1876035771679360:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 26us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127486.974333:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 377 00000100:00100000:2.0:1789127486.974343:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 378 00000100:00100000:2.0:1789127486.974349:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771679872:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127486.974371:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e72940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2400:x1876035771679872:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 22us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127486.974384:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 378 00000100:00100000:2.0:1789127486.974404:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771679744 00000100:00100000:2.0:1789127486.974407:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771679744 00000100:00100000:2.0:1789127486.974430:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771679616 00000100:00100000:2.0:1789127486.974433:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771679616 00000100:00100000:2.0:1789127486.974450:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 146 00000100:00100000:2.0:1789127486.974456:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771679744:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127486.974483:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2400:x1876035771679744:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 27us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127486.974489:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 146 00000100:00100000:2.0:1789127486.974500:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 147 00000100:00100000:2.0:1789127486.974505:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2400:x1876035771679616:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127486.974557:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e71a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2400:x1876035771679616:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 51us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127486.974562:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 147 00000100:00080000:2.0:1789127486.974688:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127486.974692:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127486.974694:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127486.974696:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127486.979732:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771679232 00000100:00100000:1.0:1789127486.979747:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771679232 00000100:00100000:1.0:1789127486.979861:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 458 00000100:00100000:1.0:1789127486.979872:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2400:x1876035771679232:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127486.979956:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2400:x1876035771679232:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 86us (6139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127486.979964:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 458 00010000:00010000:0.0:1789127487.418026:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127488.441745:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127488.824969:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127488.824990:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789557760:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127488.825066:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127488.825457:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789557760 00000100:00100000:1.0:1789127488.825465:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789557760 00000100:00100000:1.0:1789127488.825551:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789127488.825561:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692920b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789557760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127488.825595:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789127488.825646:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692920b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789557760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127488.825653:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789127488.825833:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789557760:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127489.350935:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789558016:0@lo:400:kworker.0 00000100:00100000:1.0:1789127489.351018:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127489.351189:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789558528:0@lo:400:kworker.0 00000100:00100000:1.0:1789127489.351219:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127489.351241:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789559040:0@lo:400:kworker.0 00000100:00100000:1.0:1789127489.351263:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127489.351288:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1789127489.351305:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789557888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127489.351332:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127489.351351:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789558400:0@lo:400:kworker.0 00000100:00100000:1.0:1789127489.351374:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127489.351391:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789558912:0@lo:400:kworker.0 00000100:00100000:1.0:1789127489.351414:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127489.351431:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789559424:0@lo:400:kworker.0 00000100:00100000:1.0:1789127489.351450:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127489.351489:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789558144:0@lo:400:kworker.0 00000100:00100000:1.0:1789127489.351533:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127489.351551:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789558656:0@lo:400:kworker.0 00000100:00100000:1.0:1789127489.351571:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127489.351593:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789559168:0@lo:400:kworker.0 00000100:00100000:1.0:1789127489.351611:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127489.351622:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789127489.351627:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789558272:0@lo:400:kworker.0 00000100:00100000:1.0:1789127489.351648:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127489.351659:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789558784:0@lo:400:kworker.0 00000100:00100000:0.0:1789127489.351957:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789558528 00000100:00100000:0.0:1789127489.351966:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789558528 00000100:00100000:0.0:1789127489.352879:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789559040 00000100:00100000:0.0:1789127489.352888:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789559040 00000100:00100000:0.0:1789127489.352906:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789558144 00000100:00100000:0.0:1789127489.352909:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789558144 00000100:00100000:0.0:1789127489.352918:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789558656 00000100:00100000:0.0:1789127489.352920:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789558656 00000100:00100000:0.0:1789127489.352930:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789559168 00000100:00100000:0.0:1789127489.352932:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789559168 00000100:00100000:0.0:1789127489.352944:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789558272 00000100:00100000:0.0:1789127489.352956:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789558272 00000100:00100000:0.0:1789127489.352975:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789127489.352984:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789558528:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789127489.353166:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789127489.353172:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127489.353272:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127489.353376:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789558528:12345-0@lo:400:kworker.0 Request processed in 394us (2156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127489.353384:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789127489.353402:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789127489.353409:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789559040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127489.353438:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eba940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789559040:12345-0@lo:400:kworker.0 Request processed in 30us (2174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127489.353444:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789127489.353457:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789127489.353463:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789558144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127489.353502:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eba580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789558144:12345-0@lo:400:kworker.0 Request processed in 39us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127489.353523:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789127489.353536:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1789127489.353542:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789558656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127489.353571:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789558656:12345-0@lo:400:kworker.0 Request processed in 29us (1998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127489.353577:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1789127489.353588:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1789127489.353594:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789559168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127489.353621:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789559168:12345-0@lo:400:kworker.0 Request processed in 28us (2009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127489.353638:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1789127489.353651:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:0.0:1789127489.353657:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692954b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789558272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127489.353770:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587eb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789559296:0@lo:400:kworker.0 00000100:00100000:1.0:1789127489.353796:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127489.353843:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692954b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789558272:12345-0@lo:400:kworker.0 Request processed in 186us (2193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127489.353848:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1789127489.360848:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127489.360876:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789559552:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127489.360948:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127489.361431:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789557888 00000100:00100000:0.0:1789127489.361439:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789557888 00000100:00100000:0.0:1789127489.361506:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789127489.361534:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789557888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789127489.361561:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127489.361603:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789557888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (10270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127489.361610:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789127489.361639:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789558016 00000100:00100000:0.0:1789127489.361644:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789558016 00000100:00100000:0.0:1789127489.361683:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1789127489.361690:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789558016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127489.361722:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789558016:12345-0@lo:400:kworker.0 Request processed in 33us (10705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127489.361729:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:0.0:1789127489.361753:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127489.361809:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789559680:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127489.361836:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127489.361867:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789559680 00000100:00100000:0.0:1789127489.361871:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789559680 00000100:00100000:0.0:1789127489.361908:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789127489.361914:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692921680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789559680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789127489.361925:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127489.361955:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692921680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789559680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127489.361961:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789127489.362010:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e72d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789559680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127489.366944:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789558912 00000100:00100000:3.0:1789127489.366957:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789558912 00000100:00080000:3.0:1789127489.366975:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127489.367018:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127489.367076:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789559424 00000100:00100000:3.0:1789127489.367080:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789559424 00000100:00100000:3.0:1789127489.367097:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789558784 00000100:00100000:3.0:1789127489.367100:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789558784 00000100:00100000:3.0:1789127489.367119:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789559296 00000100:00100000:3.0:1789127489.367134:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789559296 00000100:00100000:3.0:1789127489.367157:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789127489.367167:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789558912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127489.367250:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789558912:12345-0@lo:400:kworker.0 Request processed in 85us (15834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127489.367258:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789127489.367278:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789127489.367284:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789559424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127489.367314:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789559424:12345-0@lo:400:kworker.0 Request processed in 31us (15863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127489.367320:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789127489.367333:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789127489.367338:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692955e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789558784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127489.367365:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692955e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789558784:12345-0@lo:400:kworker.0 Request processed in 27us (14094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127489.367371:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789127489.367382:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789127489.367388:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789559296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127489.367414:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789559296:12345-0@lo:400:kworker.0 Request processed in 27us (13617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127489.367420:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:3.0:1789127489.367435:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127489.367852:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789558400 00000100:00100000:2.0:1789127489.367858:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789558400 00000100:00100000:2.0:1789127489.367909:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789559552 00000100:00100000:2.0:1789127489.367913:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789559552 00000100:00100000:2.0:1789127489.367926:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789127489.367933:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789558400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127489.367975:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789558400:12345-0@lo:400:kworker.0 Request processed in 43us (16600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127489.367982:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789127489.368013:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789127489.368018:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789559552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789127489.368171:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789127489.368298:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e71e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789559552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 278us (7349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127489.368304:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1789127489.368865:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1789127489.368872:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:2.0:1789127489.368889:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff934588e18b40, transno 4294967311 00000100:00100000:2.0:1789127489.368909:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789557888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127489.368923:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789558400:0@lo:400:kworker.0 00000100:00100000:2.0:1789127489.368933:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1789127489.368936:0:3653:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff934588e5c780, transno 4294967323 00000004:00080000:2.0:1789127489.368945:0:3653:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1789127489.368957:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789558912:0@lo:400:kworker.0 00000100:00100000:2.0:1789127489.368968:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eba1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789559424:0@lo:400:kworker.0 00000100:00100000:2.0:1789127489.368977:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789558016:0@lo:400:kworker.0 00000100:00100000:2.0:1789127489.369001:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789558528:0@lo:400:kworker.0 00000100:00100000:2.0:1789127489.369024:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eb8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789559040:0@lo:400:kworker.0 00000100:00100000:0.0:1789127489.371269:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eb83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789559296:0@lo:400:kworker.0 00000100:00100000:0.0:1789127489.371288:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789558144:0@lo:400:kworker.0 00010000:00080000:0.0:1789127489.371303:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587eb9680 x1876035789558656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127489.371312:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587eb9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789558656:0@lo:400:kworker.0 00010000:00080000:0.0:1789127489.371321:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebb840 x1876035789559168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127505 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127489.371329:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789559168:0@lo:400:kworker.0 00000100:00100000:0.0:1789127489.371362:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789558272:0@lo:400:kworker.0 00000100:00100000:0.0:1789127489.371375:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789558784:0@lo:400:kworker.0 00000100:00100000:3.0:1789127489.378364:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e75680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789559552:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789127489.465117:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127489.848113:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934588e77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789559808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127489.848181:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127489.848302:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789559808 00000100:00100000:3.0:1789127489.848310:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789559808 00000100:00100000:3.0:1789127489.848365:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789127489.848390:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789559808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127489.848418:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789127489.848467:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e70780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789559808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127489.848487:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127489.848490:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789127489.848503:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692956d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789559936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127489.848534:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934588e77840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789559808:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789127489.848557:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127489.850393:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789559936 00000100:00100000:0.0:1789127489.850406:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789559936 00000100:00100000:0.0:1789127489.850492:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789127489.850503:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692954f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789559936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789127489.850545:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789127489.850623:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692954f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789559936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (2067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127489.850639:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789127489.850824:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692956d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789559936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127490.125158:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127490.127303:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771680128 00000100:00100000:0.0:1789127490.127316:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771680128 00000100:00100000:0.0:1789127490.127396:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 255 00000100:00100000:0.0:1789127490.127407:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:12434:x1876035771680128:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789127490.127540:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e72d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:12434:x1876035771680128:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 Request processed in 135us (2388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127490.127547:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 255 00000100:00080000:3.0:1789127490.127744:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127490.129273:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127490.132048:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771680256 00000100:00100000:0.0:1789127490.132061:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771680256 00000100:00100000:0.0:1789127490.132140:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 256 00000100:00100000:0.0:1789127490.132151:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:12434:x1876035771680256:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 00000100:00080000:3.0:1789127490.132219:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127490.132306:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e770c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:12434:x1876035771680256:12345-192.168.206.48@tcp:60:lhsmtool_posix.0 Request processed in 157us (3038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127490.132314:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 256 00000100:00100000:0.0:1789127490.143937:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127490.145056:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771680512 00000100:00100000:3.0:1789127490.145067:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771680512 00000100:00100000:3.0:1789127490.145136:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:3.0:1789127490.145146:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:12434:x1876035771680512:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789127490.145393:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:12434:x1876035771680512:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 248us (1465us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1789127490.145403:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:2.0:1789127490.356155:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127490.356609:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771680640 00000100:00100000:0.0:1789127490.356620:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771680640 00000100:00100000:0.0:1789127490.356713:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 257 00000100:00100000:0.0:1789127490.356724:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:13247:x1876035771680640:12345-192.168.206.48@tcp:101:lsof.0 00010000:00010000:0.0:1789127490.356746:0:6523:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1789127490.356798:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789127490.356800:0:6523:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e6ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6effffbb expref: -99 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127490.356863:0:6523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e6b5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127490.357055:0:6523:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127490.357071:0:6523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127490.357346:0:6523:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789127490.357351:0:6523:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127490.357378:0:6523:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e6b5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6523 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127490.357404:0:6523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec000/0xd718aadfd785e6ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffbb expref: 7 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127490.357421:0:6523:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e6b5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffbb expref: 6 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127490.357429:0:6523:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586f6bb00) 00010000:00010000:0.0:1789127490.357432:0:6523:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127490.357435:0:6523:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fede00, rc 0) 00000100:00100000:0.0:1789127490.357499:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:13247:x1876035771680640:12345-192.168.206.48@tcp:101:lsof.0 Request processed in 777us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127490.357547:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 257 00010000:00010000:0.0:1789127490.490346:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789127491.064202:0:14505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789127491.512826:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789127491.576158:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789127491.576167:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789127491.576240:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789127491.576245:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789127492.093236:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127492.093282:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127492.093316:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127492.093339:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127492.093354:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127492.093370:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127492.093399:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127492.093426:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771681152 00000100:00100000:3.0:1789127492.093434:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771681152 00000100:00100000:3.0:1789127492.093484:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771681280 00000100:00100000:3.0:1789127492.093499:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771681280 00000100:00100000:3.0:1789127492.093566:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 152 00000100:00100000:0.0:1789127492.093573:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771680896 00000100:00100000:3.0:1789127492.093579:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771681152:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127492.093581:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771680896 00000100:00100000:0.0:1789127492.093612:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771681408 00000100:00100000:0.0:1789127492.093616:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771681408 00000100:00100000:3.0:1789127492.093654:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e75680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2401:x1876035771681152:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 78us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127492.093655:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 153 00000100:00100000:3.0:1789127492.093668:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 152 00000100:00100000:1.0:1789127492.093675:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771681280:12345-192.168.206.48@tcp:400:kworker.0 00000100:00080000:3.0:1789127492.093694:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789127492.093699:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127492.093702:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127492.093724:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771680768 00000100:00100000:1.0:1789127492.093724:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771681280:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 55us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127492.093731:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771680768 00000100:00100000:1.0:1789127492.093735:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 153 00000100:00100000:3.0:1789127492.093764:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 460 00000100:00100000:3.0:1789127492.093772:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771680768:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127492.093802:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2401:x1876035771680768:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 31us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127492.093826:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 460 00000100:00100000:3.0:1789127492.093858:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771681024 00000100:00100000:3.0:1789127492.093862:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771681024 00000100:00100000:3.0:1789127492.093890:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771681536 00000100:00100000:3.0:1789127492.093894:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771681536 00000100:00100000:1.0:1789127492.093906:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 385 00000100:00100000:1.0:1789127492.093916:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:2401:x1876035771680896:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127492.093954:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e77840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:2401:x1876035771680896:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 40us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127492.094235:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 386 00000100:00100000:3.0:1789127492.094243:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771681024:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127492.094273:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2401:x1876035771681024:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 31us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127492.094279:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 386 00000100:00100000:3.0:1789127492.094291:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 387 00000100:00100000:3.0:1789127492.094299:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771681536:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127492.094332:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2401:x1876035771681536:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 34us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127492.094338:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 387 00000100:00080000:3.0:1789127492.094355:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127492.097328:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 385 00000100:00100000:3.0:1789127492.099089:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 388 00000100:00100000:3.0:1789127492.099105:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2401:x1876035771681408:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127492.099196:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2401:x1876035771681408:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 97us (5879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127492.099204:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 388 00010000:00010000:2.0:1789127492.536605:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789127492.923204:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1789127492.923218:0:6501:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1789127492.923294:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1789127492.923304:0:6554:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789127493.560470:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127493.944623:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692956d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789560064:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127493.944694:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127493.944862:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789560064 00000100:00100000:1.0:1789127493.944870:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789560064 00000100:00100000:1.0:1789127493.944920:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789127493.944929:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789560064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127493.944959:0:7745:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789127493.945027:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789560064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127493.945035:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789127493.945160:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692956d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789560064:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127494.455736:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127494.455759:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789560448:0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.455822:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127494.455884:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789560448 00000100:00100000:1.0:1789127494.455891:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789560448 00000100:00100000:1.0:1789127494.455937:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789127494.456037:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692956580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789560448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.456092:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692956580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789560448:12345-0@lo:400:kworker.0 Request processed in 135us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127494.456100:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:1.0:1789127494.456144:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789560448:0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.456183:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789560576:0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.456210:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127494.456260:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127494.456266:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789560960:0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.456293:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127494.456316:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789560960 00000100:00100000:1.0:1789127494.456320:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789560960 00000100:00100000:1.0:1789127494.456370:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789127494.456378:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789560960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.456412:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789560960:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127494.456417:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:1.0:1789127494.456433:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127494.456452:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789560960:0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.456479:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789561088:0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.456500:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127494.456549:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789561088 00000100:00100000:1.0:1789127494.456553:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789561088 00000100:00100000:1.0:1789127494.456578:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789127494.456583:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789561088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.456621:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789561088:12345-0@lo:400:kworker.0 Request processed in 38us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127494.456627:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:1.0:1789127494.456642:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127494.456656:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789561088:0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.456692:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127494.456698:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789561472:0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.456721:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127494.456750:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789561472 00000100:00100000:1.0:1789127494.456754:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789561472 00000100:00100000:1.0:1789127494.456780:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789127494.456787:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789561472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.456820:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789561472:12345-0@lo:400:kworker.0 Request processed in 34us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127494.456826:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1789127494.456839:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127494.456856:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789561472:0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.456885:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789561600:0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.456907:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127494.456929:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789561600 00000100:00100000:1.0:1789127494.456932:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789561600 00000100:00100000:1.0:1789127494.456957:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789127494.457088:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789560320:0@lo:400:kworker.0 00000100:00100000:2.0:1789127494.457117:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127494.457135:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789560832:0@lo:400:kworker.0 00000100:00100000:2.0:1789127494.457152:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127494.457167:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789561344:0@lo:400:kworker.0 00000100:00100000:2.0:1789127494.457186:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127494.457203:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789127494.457209:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789560192:0@lo:400:kworker.0 00000100:00100000:2.0:1789127494.457233:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127494.457262:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789560704:0@lo:400:kworker.0 00000100:00100000:2.0:1789127494.457282:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127494.457297:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789561216:0@lo:400:kworker.0 00000100:00100000:2.0:1789127494.457315:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127494.457333:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789560320 00000100:00100000:2.0:1789127494.457336:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789560320 00000100:00100000:2.0:1789127494.457356:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789560832 00000100:00100000:2.0:1789127494.457359:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789560832 00000100:00100000:2.0:1789127494.457372:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789561344 00000100:00100000:2.0:1789127494.457375:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789561344 00000100:00100000:2.0:1789127494.457385:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789560704 00000100:00100000:2.0:1789127494.457387:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789560704 00000100:00100000:2.0:1789127494.457397:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789561216 00000100:00100000:2.0:1789127494.457399:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789561216 00000100:00100000:2.0:1789127494.457410:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789127494.457415:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789560320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127494.457450:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789560320:12345-0@lo:400:kworker.0 Request processed in 34us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127494.457456:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789127494.457468:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1789127494.457473:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789560832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127494.457498:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789560832:12345-0@lo:400:kworker.0 Request processed in 25us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127494.457504:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1789127494.457532:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1789127494.457539:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789561344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127494.457564:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eb8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789561344:12345-0@lo:400:kworker.0 Request processed in 26us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127494.457578:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1789127494.457590:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1789127494.457596:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789560704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127494.457625:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789560704:12345-0@lo:400:kworker.0 Request processed in 29us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127494.457630:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1789127494.457642:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1789127494.457647:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587eba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789561216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127494.457674:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587eba1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3651:x1876035789561216:12345-0@lo:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127494.457680:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1789127494.457709:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789560704:0@lo:400:kworker.0 00000100:00100000:2.0:1789127494.457719:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789561216:0@lo:400:kworker.0 00000100:00100000:2.0:1789127494.457728:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789560320:0@lo:400:kworker.0 00010000:00080000:2.0:1789127494.457739:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7fabc00 x1876035789560832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127494.457748:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789560832:0@lo:400:kworker.0 00010000:00080000:2.0:1789127494.457758:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b7fa9680 x1876035789561344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127510 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127494.457766:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789561344:0@lo:400:kworker.0 00000100:00100000:0.0:1789127494.458010:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789561728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127494.458046:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127494.458078:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789560576 00000100:00100000:0.0:1789127494.458082:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789560576 00000100:00100000:0.0:1789127494.458108:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789561728 00000100:00100000:0.0:1789127494.458111:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789561728 00000100:00100000:0.0:1789127494.458124:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789127494.458129:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692956d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789560576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127494.458165:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692956d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789560576:12345-0@lo:400:kworker.0 Request processed in 35us (1954us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127494.458171:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789127494.458183:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789127494.458189:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789561728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789127494.458211:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127494.458243:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929221c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789561728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127494.458249:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789127494.458267:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789560192 00000100:00100000:0.0:1789127494.458270:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789560192 00000100:00100000:0.0:1789127494.458293:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1789127494.458299:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789560192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127494.458326:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1843050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3651:x1876035789560192:12345-0@lo:400:kworker.0 Request processed in 28us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127494.458332:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:0.0:1789127494.458388:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789561728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127494.458412:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789560576:0@lo:400:kworker.0 00000100:00100000:2.0:1789127494.458634:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789561856:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127494.458664:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127494.458787:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789561600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.458824:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7faa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789561600:12345-0@lo:400:kworker.0 Request processed in 44us (1916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127494.458831:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789127494.458881:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789561984:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789127494.458914:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127494.458918:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127494.458921:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127494.459047:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789560192:0@lo:400:kworker.0 00000100:00100000:1.0:1789127494.459173:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127494.459218:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789561600:0@lo:400:kworker.0 00000100:00100000:3.0:1789127494.465835:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789561856 00000100:00100000:3.0:1789127494.465852:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789561856 00000100:00100000:3.0:1789127494.466037:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789561984 00000100:00100000:3.0:1789127494.466041:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789561984 00000100:00100000:3.0:1789127494.466068:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789127494.466076:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692957840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789561856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789127494.466105:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127494.466177:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692957840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789561856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (7512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127494.466184:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789127494.466200:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789127494.466206:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789561984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127494.466215:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789127494.466250:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789561984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (7077us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127494.466272:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789127494.466373:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789561856:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127494.466479:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789561984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789127494.584313:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789127494.720126:0:15763:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 07:51:32 (1789127492) 00000100:00100000:3.0:1789127494.967769:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127494.967794:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789562112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789127494.967859:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127494.967994:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789562112 00000100:00100000:1.0:1789127494.968002:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789562112 00000100:00100000:1.0:1789127494.968060:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789127494.968069:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789562112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127494.968097:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789127494.968256:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789562112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127494.968264:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789127494.970839:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346929203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789562240:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127494.970901:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127494.970949:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789562240 00000100:00100000:0.0:1789127494.970956:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789562240 00000100:00100000:0.0:1789127494.971004:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789127494.971012:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692920780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789562240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789127494.971033:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789127494.971072:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692920780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789562240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127494.971079:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789127494.971123:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346929203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789562240:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127494.977814:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7faa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789562112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789127495.626689:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127496.633069:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127497.217012:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127497.217048:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127497.217077:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127497.217097:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127497.217111:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127497.217127:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127497.217147:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127497.217172:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771682176 00000100:00100000:2.0:1789127497.217180:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771682176 00000100:00100000:2.0:1789127497.217225:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771682048 00000100:00100000:2.0:1789127497.217228:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771682048 00000100:00100000:2.0:1789127497.217246:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 158 00000100:00100000:2.0:1789127497.217253:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692957c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771682176:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127497.217310:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692957c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771682176:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 57us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127497.217317:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 158 00000100:00100000:2.0:1789127497.217330:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 159 00000100:00100000:2.0:1789127497.217336:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2399:x1876035771682048:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127497.217354:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2399:x1876035771682048:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 19us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127497.217360:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 159 00000100:00100000:2.0:1789127497.217398:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771681920 00000100:00100000:2.0:1789127497.217401:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771681920 00000100:00100000:2.0:1789127497.217418:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771682432 00000100:00100000:2.0:1789127497.217420:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771682432 00000100:00100000:2.0:1789127497.217428:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771681792 00000100:00100000:2.0:1789127497.217430:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771681792 00000100:00100000:2.0:1789127497.217440:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771682304 00000100:00100000:2.0:1789127497.217442:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771682304 00000100:00100000:2.0:1789127497.217456:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 395 00000100:00100000:2.0:1789127497.217461:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771681920:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127497.217471:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 396 00000100:00100000:2.0:1789127497.217487:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2399:x1876035771681920:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127497.217490:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771682432:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127497.217493:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 395 00000100:00100000:2.0:1789127497.217504:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 397 00000100:00100000:2.0:1789127497.217528:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:2399:x1876035771681792:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127497.217537:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2399:x1876035771682432:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 60us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127497.217544:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 396 00000100:00100000:2.0:1789127497.217549:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:2399:x1876035771681792:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 40us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127497.217554:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 397 00000100:00100000:0.0:1789127497.217558:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 398 00000100:00100000:0.0:1789127497.217564:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2399:x1876035771682304:12345-192.168.206.48@tcp:400:kworker.0 00000100:00080000:2.0:1789127497.217576:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127497.217579:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127497.217582:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127497.217584:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789127497.217585:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2399:x1876035771682304:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 22us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127497.217596:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 398 00000100:00100000:3.0:1789127497.218113:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771681664 00000100:00100000:3.0:1789127497.218119:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771681664 00000100:00100000:3.0:1789127497.218166:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 462 00000100:00100000:3.0:1789127497.218173:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771681664:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127497.218210:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771681664:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 38us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127497.218217:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 462 00010000:00010000:0.0:1789127497.662216:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127498.679664:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127499.063823:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789562368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127499.063891:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127499.064016:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789562368 00000100:00100000:1.0:1789127499.064023:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789562368 00000100:00100000:1.0:1789127499.064082:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789127499.064100:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789562368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127499.064132:0:6527:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1789127499.064176:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789562368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127499.064182:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789127499.064565:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fa92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789562368:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127499.133074:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127499.133253:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771682688 00000100:00100000:0.0:1789127499.133263:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771682688 00000100:00100000:0.0:1789127499.133343:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:0.0:1789127499.133354:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+18:13470:x1876035771682688:12345-192.168.206.48@tcp:35:umount.0 00000100:00100000:0.0:1789127499.133716:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:13470:x1876035771682688:12345-192.168.206.48@tcp:35:umount.0 Request processed in 362us (647us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1789127499.133724:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00080000:2.0:1789127499.136686:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127499.147989:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127499.148156:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771682944 00000100:00100000:0.0:1789127499.148166:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771682944 00000100:00100000:0.0:1789127499.148267:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:0.0:1789127499.148278:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+19:13470:x1876035771682944:12345-192.168.206.48@tcp:35:umount.0 00000100:00100000:0.0:1789127499.148578:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:13470:x1876035771682944:12345-192.168.206.48@tcp:35:umount.0 Request processed in 302us (598us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789127499.148586:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:1.0:1789127499.151708:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127499.151915:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771683200 00000100:00100000:0.0:1789127499.151924:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771683200 00000100:00100000:0.0:1789127499.151972:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:0.0:1789127499.151982:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346a9d66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+20:13470:x1876035771683200:12345-192.168.206.48@tcp:35:umount.0 00000100:00100000:0.0:1789127499.152281:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346a9d66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:13470:x1876035771683200:12345-192.168.206.48@tcp:35:umount.0 Request processed in 300us (580us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1789127499.152290:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:2.0:1789127499.154770:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127499.154901:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771683456 00000100:00100000:0.0:1789127499.154919:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771683456 00000100:00100000:0.0:1789127499.155232:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:0.0:1789127499.155246:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:13470:x1876035771683456:12345-192.168.206.48@tcp:35:umount.0 00000100:00100000:0.0:1789127499.156125:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:13470:x1876035771683456:12345-192.168.206.48@tcp:35:umount.0 Request processed in 880us (1372us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789127499.156136:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:1.0:1789127499.159458:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127499.159792:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771683712 00000100:00100000:3.0:1789127499.159806:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771683712 00000100:00100000:1.0:1789127499.159813:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127499.160021:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771683584 00000100:00100000:0.0:1789127499.160027:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771683584 00000100:00100000:3.0:1789127499.160062:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:3.0:1789127499.160075:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3763f5ac-303c-4f4d-b89b-7863c202d0a8+14:2399:x1876035771683712:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127499.160095:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127499.160120:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928ffe00/0xd718aadfd785d535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffab3 expref: 14 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127499.160141:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127499.160155:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:0.0:1789127499.160170:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7faa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+13:2399:x1876035771683584:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127499.160181:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127499.160193:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928fec00/0xd718aadfd785d5f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaf2 expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127499.160204:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127499.160218:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7fa92c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:2399:x1876035771683712:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 144us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127499.160231:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7faa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+12:2399:x1876035771683584:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 67us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127499.160240:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:3.0:1789127499.160728:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:2.0:1789127499.164080:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127499.164129:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127499.164200:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771683968 00000100:00100000:3.0:1789127499.164208:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771683840 00000100:00100000:1.0:1789127499.164213:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771683968 00000100:00100000:3.0:1789127499.164214:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771683840 00000100:00100000:1.0:1789127499.164302:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 80 00000100:00100000:1.0:1789127499.164314:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2398:x1876035771683968:12345-192.168.206.48@tcp:9:umount.0 00000020:00000080:1.0:1789127499.164351:0:8755:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d9aa 00000100:00080000:1.0:1789127499.164361:0:8755:0:(import.c:65:import_set_state_nolock()) ffff934587e15000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789127499.164416:0:8755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1789127499.164656:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:2eecd753-97f2-4dc9-9442-17e5ef8fda22+2:2398:x1876035771683968:12345-192.168.206.48@tcp:9:umount.0 Request processed in 344us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127499.164665:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 80 00010000:00010000:1.0:1789127499.164698:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789127499.164830:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127499.165048:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:3.0:1789127499.165063:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934588e5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+11:2401:x1876035771683840:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127499.165077:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127499.165100:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9345886d7000/0xd718aadfd785d8a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbe7 expref: 11 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127499.165119:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127499.165158:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934588e5d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2401:x1876035771683840:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 101us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127499.165166:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:2.0:1789127499.170760:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127499.171008:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771684352 00000100:00100000:1.0:1789127499.171021:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771684352 00000100:00100000:1.0:1789127499.171183:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 81 00000100:00100000:1.0:1789127499.171196:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+7:2398:x1876035771684352:12345-192.168.206.48@tcp:9:umount.0 00000020:00000080:1.0:1789127499.171242:0:10363:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785dc19 00000020:00010000:1.0:1789127499.171252:0:10363:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9345887f1000: total 0 00000100:00080000:1.0:1789127499.171258:0:10363:0:(import.c:65:import_set_state_nolock()) ffff9345887f1800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789127499.171327:0:10363:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789127499.171611:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2398:x1876035771684352:12345-192.168.206.48@tcp:9:umount.0 Request processed in 416us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127499.171620:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 81 00000020:00010000:0.0:1789127499.171681:0:6510:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9345887f1000: total 0 00010000:00010000:0.0:1789127499.171727:0:6510:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9345887f1000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789127499.171791:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e53e0f6/0xd718aadfd785e6a7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffb4 expref: 4 pid: 8439 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127499.171832:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020a3c7f2/0xd718aadfd785dfd8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdd1 expref: 3 pid: 8440 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127499.171849:0:6510:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9345887f1000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789127499.171890:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127499.171892:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127499.171894:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789127499.172099:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127499.178085:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127499.178558:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771685376 00000100:00100000:2.0:1789127499.178572:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771685376 00000100:00100000:2.0:1789127499.178651:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 258 00000100:00100000:2.0:1789127499.178663:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+22:2398:x1876035771685376:12345-192.168.206.48@tcp:39:umount.0 00000020:00000080:2.0:1789127499.178704:0:6523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d543 00000020:00010000:2.0:1789127499.178725:0:6523:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9346aec87000: total 0 00000100:00080000:2.0:1789127499.178730:0:6523:0:(import.c:65:import_set_state_nolock()) ffff9346aec85000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789127499.178775:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:3.0:1789127499.178832:0:8454:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9346aec87000: total 0 00010000:00010000:3.0:1789127499.178976:0:8454:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9346aec87000, canceled 0 locks, left on hash table 13. 00000100:00100000:2.0:1789127499.178982:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7faa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2eecd753-97f2-4dc9-9442-17e5ef8fda22+21:2398:x1876035771685376:12345-192.168.206.48@tcp:39:umount.0 Request processed in 319us (908us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1789127499.178992:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 258 00010000:00010000:3.0:1789127499.179021:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:3.0:1789127499.179026:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789127499.179046:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7e00/0xd718aadfd785df99 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdbc expref: 20 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127499.179725:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:2.0:1789127499.179731:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789127499.179738:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b000/0xd718aadfd785e34a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffecd expref: 19 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127499.179766:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586f6bb00) 00010000:00010000:2.0:1789127499.179769:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127499.179773:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785e041 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffded expref: 18 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127499.179891:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4200) 00010000:00010000:2.0:1789127499.179894:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127499.179916:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785d925 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbfc expref: 17 pid: 9447 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127499.179954:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:2.0:1789127499.179956:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789127499.179961:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785e588 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff67 expref: 16 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127499.179974:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:2.0:1789127499.179976:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789127499.179980:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785dfc3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdca expref: 15 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127499.179992:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:2.0:1789127499.179994:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789127499.179997:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93469a7a1200/0xd718aadfd785dc7b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffcea expref: 14 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127499.180011:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9346a69cb900) 00010000:00010000:2.0:1789127499.180013:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127499.180017:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587feca00/0xd718aadfd785d909 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbf5 expref: 13 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127499.180031:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9346a69cbb00) 00010000:00010000:2.0:1789127499.180033:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789127499.180037:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9345886d7800/0xd718aadfd785e05d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffdf4 expref: 12 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127499.180051:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff934587df4700) 00010000:00010000:2.0:1789127499.180059:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789127499.180064:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587feda00/0xd718aadfd785deb9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffd84 expref: 11 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127499.180081:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff934587df4600) 00010000:00010000:2.0:1789127499.180087:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789127499.180093:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec200/0xd718aadfd785d980 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffc11 expref: 10 pid: 6522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127499.180108:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:2.0:1789127499.180110:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127499.180113:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858da00/0xd718aadfd785e668 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effff9f expref: 9 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127499.180126:0:8454:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff93468b042f00) 00010000:00010000:2.0:1789127499.180128:0:8454:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789127499.180132:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fec600/0xd718aadfd785e692 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffad expref: 8 pid: 6524 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127499.180266:0:8454:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9346aec87000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789127499.180359:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127499.180362:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127499.180364:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127499.195422:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127499.195730:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771685504 00000100:00100000:2.0:1789127499.195742:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771685504 00000100:00100000:2.0:1789127499.196066:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 259 00000100:00100000:2.0:1789127499.196079:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+5:2398:x1876035771685504:12345-192.168.206.48@tcp:39:umount.0 00000100:00080000:1.0:1789127499.196086:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:2.0:1789127499.196122:0:6522:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d54a 00000100:00080000:2.0:1789127499.196158:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9346aec86000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789127499.196256:0:6522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1789127499.197760:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127499.200254:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2eecd753-97f2-4dc9-9442-17e5ef8fda22+3:2398:x1876035771685504:12345-192.168.206.48@tcp:39:umount.0 Request processed in 4168us (4834us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789127499.200268:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 259 00000100:00100000:0.0:1789127499.575982:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789127499.576004:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789562496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127499.576073:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127499.576226:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789562496 00000100:00100000:2.0:1789127499.576234:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789562496 00000100:00100000:2.0:1789127499.576290:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789127499.576300:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789562496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127499.576328:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127499.576372:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929203c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789562496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 74us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127499.576391:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789127499.576630:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789562752:0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.576678:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127499.576705:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789563264:0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.576732:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127499.576765:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789563776:0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.576787:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127499.576806:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789127499.576811:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789562880:0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.576833:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127499.576849:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789563392:0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.576870:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127499.576884:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789563904:0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.576903:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127499.576922:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789563264 00000100:00100000:1.0:1789127499.576927:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789563264 00000100:00100000:1.0:1789127499.576964:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789563776 00000100:00100000:1.0:1789127499.576967:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789563776 00000100:00100000:1.0:1789127499.576980:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789562880 00000100:00100000:1.0:1789127499.576983:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789562880 00000100:00100000:1.0:1789127499.576992:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789563392 00000100:00100000:1.0:1789127499.576995:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789563392 00000100:00100000:1.0:1789127499.577004:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789563904 00000100:00100000:1.0:1789127499.577006:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789563904 00000100:00100000:1.0:1789127499.577021:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789127499.577027:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789563264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.577067:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789563264:12345-0@lo:400:kworker.0 Request processed in 39us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127499.577073:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789127499.577087:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1789127499.577093:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789563776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.577120:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789563776:12345-0@lo:400:kworker.0 Request processed in 28us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127499.577136:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00100000:1.0:1789127499.577148:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1789127499.577153:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789562880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.577182:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789562880:12345-0@lo:400:kworker.0 Request processed in 29us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127499.577188:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:1.0:1789127499.577199:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1789127499.577205:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789563392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.577231:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789563392:12345-0@lo:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127499.577236:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:1.0:1789127499.577247:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1789127499.577253:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789563904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.577279:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789563904:12345-0@lo:400:kworker.0 Request processed in 27us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127499.577285:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:1.0:1789127499.577326:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fabc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789562880:0@lo:400:kworker.0 00010000:00080000:1.0:1789127499.577341:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ffb840 x1876035789563392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127499.577353:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789563392:0@lo:400:kworker.0 00010000:00080000:1.0:1789127499.577361:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ffa1c0 x1876035789563904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127499.577370:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789563904:0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.577389:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789563264:0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.577398:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789563776:0@lo:400:kworker.0 00000100:00100000:3.0:1789127499.577584:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789563008:0@lo:400:kworker.0 00000100:00100000:3.0:1789127499.577678:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127499.577729:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789563520:0@lo:400:kworker.0 00000100:00100000:0.0:1789127499.577886:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789562752 00000100:00100000:0.0:1789127499.577894:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789562752 00000100:00100000:3.0:1789127499.577900:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127499.577952:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:0.0:1789127499.577961:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789562752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127499.578012:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1841050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3650:x1876035789562752:12345-0@lo:400:kworker.0 Request processed in 52us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127499.578019:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00080000:0.0:1789127499.578049:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127499.578054:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127499.578057:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127499.578059:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789564032:0@lo:400:kworker.0 00000100:00100000:0.0:1789127499.578076:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789562624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127499.578132:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127499.578142:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127499.578183:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789563136:0@lo:400:kworker.0 00000100:00100000:0.0:1789127499.578221:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127499.578250:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789563520 00000100:00100000:0.0:1789127499.578256:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789563648:0@lo:400:kworker.0 00000100:00100000:3.0:1789127499.578260:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789563520 00000100:00100000:0.0:1789127499.578286:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127499.578317:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690404780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789564160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127499.578333:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789564032 00000100:00100000:3.0:1789127499.578338:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789564032 00000100:00100000:0.0:1789127499.578351:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127499.578376:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789563648 00000100:00100000:3.0:1789127499.578381:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789563648 00000100:00100000:0.0:1789127499.578425:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789562496:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789127499.578469:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789562624 00000100:00100000:0.0:1789127499.578474:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789562624 00000100:00100000:3.0:1789127499.578483:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789127499.578497:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789563520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127499.578589:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789563520:12345-0@lo:400:kworker.0 Request processed in 96us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127499.578597:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789127499.578716:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789563136 00000100:00100000:0.0:1789127499.578722:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789563136 00000100:00100000:0.0:1789127499.578739:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789127499.578747:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692921a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789562624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789127499.578772:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789127499.578820:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692921a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3653:x1876035789562624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127499.578826:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789127499.578841:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789127499.578848:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690654050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789563136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127499.578875:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690654050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789563136:12345-0@lo:400:kworker.0 Request processed in 29us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127499.578881:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1789127499.579030:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789127499.579048:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789564032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127499.579107:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789564032:12345-0@lo:400:kworker.0 Request processed in 68us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127499.579117:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789127499.579137:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789127499.579145:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789563648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127499.579189:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929212c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789563648:12345-0@lo:400:kworker.0 Request processed in 46us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127499.579197:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789127499.579265:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789563520:0@lo:400:kworker.0 00000100:00100000:3.0:1789127499.579292:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789564032:0@lo:400:kworker.0 00000100:00080000:3.0:1789127499.579377:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789127499.579383:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127499.579408:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789564160 00000100:00100000:0.0:1789127499.579416:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789564160 00000100:00100000:3.0:1789127499.579451:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fa9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789562752:0@lo:400:kworker.0 00000100:00100000:0.0:1789127499.579453:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789127499.579472:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789564160:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127499.579553:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fa8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789562624:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127499.579567:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789563136:0@lo:400:kworker.0 00000100:00100000:3.0:1789127499.579590:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789563648:0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.579899:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789563008 00000100:00100000:1.0:1789127499.579908:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789563008 00000100:00100000:1.0:1789127499.579974:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789127499.579982:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789563008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127499.580039:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789563008:12345-0@lo:400:kworker.0 Request processed in 59us (2365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127499.580046:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:1.0:1789127499.580085:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7fab840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789563008:0@lo:400:kworker.0 00002000:00000024:0.0:1789127499.588898:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789127499.589010:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789564160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9538us (10657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127499.589021:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789127499.590005:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690404780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789564160:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789127499.706947:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127500.088200:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127500.088236:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789564288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127500.088332:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127500.088401:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789564288 00000100:00100000:1.0:1789127500.088424:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789564288 00000100:00100000:1.0:1789127500.088495:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789127500.088506:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690406d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789564288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789127500.088569:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789127500.088859:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690406d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789564288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 353us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127500.088867:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789127500.088970:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789564288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127500.091063:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789564416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789127500.091134:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127500.091276:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789564416 00000100:00100000:0.0:1789127500.091283:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789564416 00000100:00100000:0.0:1789127500.091329:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789127500.091351:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690404780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789564416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789127500.091372:0:8441:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789127500.091436:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690404780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789564416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127500.091443:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789127500.091659:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789564416:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789127500.727670:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127501.304337:0:14505:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789127501.751796:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127501.815724:0:14502:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789127501.815746:0:14502:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789127501.815834:0:14502:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1789127501.815841:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789127501.870376:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127501.870490:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771685888 00000100:00100000:1.0:1789127501.870499:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771685888 00000100:00100000:1.0:1789127501.870597:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:1.0:1789127501.870607:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2400:x1876035771685888:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127501.870623:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127501.870650:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501a200/0xd718aadfd785d646 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb07 expref: 10 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127501.870667:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127501.870723:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:2400:x1876035771685888:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 117us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127501.870732:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:1.0:1789127501.872016:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127501.872051:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127501.872109:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771685632 00000100:00100000:3.0:1789127501.872116:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771685632 00000100:00100000:3.0:1789127501.872163:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771685760 00000100:00100000:3.0:1789127501.872166:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771685760 00000100:00100000:3.0:1789127501.872199:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:3.0:1789127501.872208:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+10:2402:x1876035771685632:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127501.872219:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127501.872233:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501a600/0xd718aadfd785d64d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffb38 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127501.872246:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127501.872284:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+9:2402:x1876035771685632:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127501.872291:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:3.0:1789127501.872305:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:3.0:1789127501.872312:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+8:2402:x1876035771685760:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127501.872319:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127501.872338:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9345886d6400/0xd718aadfd785d8a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffbe0 expref: 8 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127501.872347:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127501.872365:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3763f5ac-303c-4f4d-b89b-7863c202d0a8+7:2402:x1876035771685760:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 54us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127501.872371:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:0.0:1789127501.888819:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127501.888996:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771686144 00000100:00100000:2.0:1789127501.889007:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771686144 00000100:00100000:2.0:1789127501.889131:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 260 00000100:00100000:2.0:1789127501.889142:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+6:2398:x1876035771686144:12345-192.168.206.48@tcp:39:umount.0 00000020:00000080:2.0:1789127501.889182:0:6523:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d65b 00000020:00010000:2.0:1789127501.889192:0:6523:0:(genops.c:1921:obd_stale_export_put()) Put export ffff934587f78800: total 0 00000100:00080000:2.0:1789127501.889215:0:6523:0:(import.c:65:import_set_state_nolock()) ffff934587f79800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789127501.889254:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:2.0:1789127501.889463:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e70b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2398:x1876035771686144:12345-192.168.206.48@tcp:39:umount.0 Request processed in 322us (653us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1789127501.889472:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 260 00000100:00080000:3.0:1789127501.889539:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:1.0:1789127501.891438:0:6510:0:(genops.c:1907:obd_stale_export_get()) Get export ffff934587f78800: total 0 00010000:00010000:1.0:1789127501.891447:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127501.891548:0:6510:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff934587f78800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789127501.891588:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586f6bb00) 00010000:00010000:1.0:1789127501.891592:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789127501.891604:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff934587fede00/0xd718aadfd785e6b5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffbb expref: 4 pid: 6523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127501.891642:0:6510:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff934587f78800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789127501.891655:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127501.891656:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127501.891658:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127501.903715:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127501.906415:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771686272 00000100:00100000:1.0:1789127501.906430:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771686272 00000100:00100000:1.0:1789127501.906538:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 261 00000100:00100000:1.0:1789127501.906548:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+5:2398:x1876035771686272:12345-192.168.206.48@tcp:39:umount.0 00000020:00000080:1.0:1789127501.906601:0:6524:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d662 00000100:00080000:1.0:1789127501.906614:0:6524:0:(import.c:65:import_set_state_nolock()) ffff934587f76800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789127501.906636:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789127501.906786:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:62f6ff54-d308-4b3f-88aa-10f2416ee4e9+3:2398:x1876035771686272:12345-192.168.206.48@tcp:39:umount.0 Request processed in 239us (3078us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789127501.906793:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 261 00010000:00010000:2.0:1789127501.906948:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789127501.907003:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127501.964075:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127501.964216:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771686528 00000100:00100000:1.0:1789127501.964226:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771686528 00000100:00100000:1.0:1789127501.964285:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 464 00000100:00100000:1.0:1789127501.964294:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b1840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+7:2398:x1876035771686528:12345-192.168.206.48@tcp:251:umount.0 00000020:00000080:1.0:1789127501.964333:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d520 00000020:00010000:1.0:1789127501.964341:0:6514:0:(genops.c:1921:obd_stale_export_put()) Put export ffff934587f7e800: total 0 00000100:00080000:1.0:1789127501.964346:0:6514:0:(import.c:65:import_set_state_nolock()) ffff934587f7b000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789127501.964425:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b1840c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:3763f5ac-303c-4f4d-b89b-7863c202d0a8+3:2398:x1876035771686528:12345-192.168.206.48@tcp:251:umount.0 Request processed in 133us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127501.964433:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 464 00000020:00010000:2.0:1789127501.964557:0:6511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff934587f7e800: total 0 00010000:00010000:2.0:1789127501.964602:0:6511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff934587f7e800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789127501.964632:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928ffc00/0xd718aadfd785d5f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6efffaf9 expref: 2 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127501.964645:0:6511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff934587f7e800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789127501.964654:0:6511:0:(genops.c:885:class_export_put()) final put ffff934587f7e800/3763f5ac-303c-4f4d-b89b-7863c202d0a8 00010000:00010000:2.0:1789127501.964668:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127501.964670:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127501.964672:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789127501.964812:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff934587f7e800/3763f5ac-303c-4f4d-b89b-7863c202d0a8 for MGS 00000020:00000080:1.0:1789127501.964843:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934587f7b000 for MGS 00010000:00010000:1.0:1789127502.775746:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127503.799680:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789127504.162845:0:15958:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000100:00100000:2.0:1789127504.189940:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127504.189968:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789564544:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127504.190052:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127504.190637:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789564544 00000100:00100000:2.0:1789127504.190647:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789564544 00000100:00100000:2.0:1789127504.190823:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789127504.190836:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789564544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127504.190880:0:6528:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789127504.190962:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789564544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127504.190970:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1789127504.191040:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789564544:0@lo:41:osp-pre-0-1.0 00000020:01000004:2.0:1789127504.193496:0:15958:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1789127504.193618:0:15958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.193633:0:15958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.193641:0:15958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.193648:0:15958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.193663:0:15958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789127504.193669:0:15958:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:2.0:1789127504.193715:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127504.193722:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.193729:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501a000 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127504.193733:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.193742:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127504.193748:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127504.193770:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789127504.193773:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789127504.193775:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789127504.193808:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.193815:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127504.193840:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.193848:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93468501a000/0xd718aadfd785d5c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d5cf expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.193858:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127504.193860:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127504.193862:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127504.193877:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789564672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127504.193946:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789127504.193998:0:15958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127504.194002:0:15958:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789127504.194007:0:15958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789127504.194019:0:15958:0:(import.c:65:import_set_state_nolock()) ffff9346bea9d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789127504.204968:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789564672 00000100:00100000:3.0:1789127504.204986:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789564672 00000100:00100000:3.0:1789127504.205119:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789127504.205131:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346a9c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3653:x1876035789564672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127504.205150:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127504.205175:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928fea00/0xd718aadfd785d5cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d5c8 expref: 24 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127504.205192:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127504.205291:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346a9c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:3653:x1876035789564672:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (11344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127504.205300:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789127504.205404:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789564672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127504.205489:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876035789564800:0@lo:39:umount.0 00000100:00100000:2.0:1789127504.205578:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127504.205758:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789564800 00000100:00100000:3.0:1789127504.205765:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789564800 00000100:00100000:3.0:1789127504.205815:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789127504.205824:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690405680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876035789564800:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789127504.205876:0:6522:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d137 00000100:00080000:3.0:1789127504.205888:0:6522:0:(import.c:65:import_set_state_nolock()) ffff9346bea9f000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789127504.205944:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127504.205988:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690405680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3649:x1876035789564800:12345-0@lo:39:umount.0 Request processed in 165us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127504.205998:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1789127504.206008:0:6522:0:(genops.c:885:class_export_put()) final put ffff9346bea9a800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:2.0:1789127504.206031:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346bea9d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:3.0:1789127504.206046:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9346bea9a800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:2.0:1789127504.206052:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876035789564800:0@lo:39:umount.0 00000100:00080000:2.0:1789127504.206103:0:15958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127504.206107:0:15958:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789127504.206113:0:15958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789127504.206120:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346bea9f000 for lustre-MDT0000 00010000:00010000:2.0:1789127504.210216:0:15958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210234:0:15958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210244:0:15958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210252:0:15958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210272:0:15958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127504.210283:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127504.210288:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210295:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fece00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127504.210299:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210308:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127504.210316:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127504.210340:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789127504.210343:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1789127504.210376:0:8454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210383:0:8454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127504.210409:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210416:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934587fece00/0xd718aadfd785d5d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d5dd expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210430:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127504.210432:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127504.210435:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127504.210449:0:15958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210457:0:15958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210462:0:15958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210469:0:15958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210482:0:15958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127504.210490:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127504.210499:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210505:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214de00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127504.210545:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210553:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127504.210561:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127504.210567:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789127504.210569:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789127504.210571:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789127504.210587:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210592:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127504.210599:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210605:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346c214de00/0xd718aadfd785d4da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d4e1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210614:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127504.210616:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127504.210618:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127504.210630:0:15958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210647:0:15958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210654:0:15958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210661:0:15958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210674:0:15958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127504.210681:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127504.210686:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210692:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7600 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127504.210695:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210702:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127504.210707:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127504.210712:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789127504.210714:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789127504.210716:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789127504.210730:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210746:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127504.210761:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210768:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9345886d7600/0xd718aadfd785d8d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d8df expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.210780:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127504.210783:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127504.210785:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127504.210804:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789565184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127504.210842:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789564928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127504.210874:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127504.211318:0:15958:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0c00/0xd718aadfd785d096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.211328:0:15958:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0c00/0xd718aadfd785d096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.211335:0:15958:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0c00/0xd718aadfd785d096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.211342:0:15958:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff93469a7a0c00/0xd718aadfd785d096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.211367:0:15958:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789127504.211720:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789565056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127504.211779:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127504.212008:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789565184 00000100:00100000:3.0:1789127504.212019:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789565184 00000100:00100000:3.0:1789127504.212080:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789565056 00000100:00100000:3.0:1789127504.212084:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789565056 00000100:00100000:3.0:1789127504.212110:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127504.212121:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587895680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+24:3652:x1876035789565184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127504.212139:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127504.212163:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93458858c800/0xd718aadfd785d8df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d8d8 expref: 24 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127504.212180:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127504.212228:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587895680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+23:3652:x1876035789565184:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127504.212237:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789127504.212256:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789127504.212263:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+22:3651:x1876035789565056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127504.212271:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127504.212295:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346928ff200/0xd718aadfd785d4e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d4da expref: 22 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127504.212305:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127504.212333:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3651:x1876035789565056:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127504.212341:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789127504.212385:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690406580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789565056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127504.212423:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789565184:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1789127504.212635:0:15958:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1789127504.212642:0:15958:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1789127504.212696:0:15958:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1789127504.212701:0:15958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1789127504.212716:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127504.212722:0:15958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1789127504.212729:0:15958:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9346aecee800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789127504.212735:0:15958:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9346b7251000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789127504.212740:0:15958:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9346a0b19000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789127504.212744:0:15958:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9346a0ab0000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:2.0:1789127504.212751:0:15958:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff934587f78800 62f6ff54-d308-4b3f-88aa-10f2416ee4e9 192.168.206.48@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789127504.212756:0:15958:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9346aec87000 2eecd753-97f2-4dc9-9442-17e5ef8fda22 192.168.206.48@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:2.0:1789127504.212761:0:15958:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9346b18f4ed8) has exports, disconnecting them 00000020:00080000:2.0:1789127504.212768:0:15958:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9346aecee800), last request at 1789127499 00000020:00000080:2.0:1789127504.212775:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d44e 00000100:00080000:2.0:1789127504.212794:0:15958:0:(import.c:65:import_set_state_nolock()) ffff9346aeced800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789127504.212851:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127504.212858:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a0c00/0xd718aadfd785d096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.212866:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0c00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127504.212869:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0c00/0xd718aadfd785d096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.212878:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a0c00/0xd718aadfd785d096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127504.212884:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0c00/0xd718aadfd785d096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127504.212889:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789127504.212898:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789127504.212900:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789127504.212947:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a0c00/0xd718aadfd785d096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.212954:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789127504.212981:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0c00/0xd718aadfd785d096 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.212989:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a0c00/0xd718aadfd785d096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d09d expref: -99 pid: 6499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127504.212999:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127504.213001:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127504.213003:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789127504.213019:0:15958:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9346aecee800): rc 0 00000020:00000080:2.0:1789127504.213022:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346aecee800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1789127504.213032:0:15958:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9346b7251000), last request at 1789127499 00000020:00000080:2.0:1789127504.213035:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d321 00000100:00080000:2.0:1789127504.213041:0:15958:0:(import.c:65:import_set_state_nolock()) ffff9346b7255800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789127504.213054:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789127504.213061:0:15958:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9346b7251000): rc 0 00000020:00000080:2.0:1789127504.213063:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346b7251000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1789127504.213068:0:15958:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9346a0b19000), last request at 1789127247 00000020:00000080:2.0:1789127504.213070:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d21e 00000100:00080000:2.0:1789127504.213073:0:15958:0:(import.c:65:import_set_state_nolock()) ffff9346a0b1a800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789127504.213083:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1789127504.213089:0:15958:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9346a0b19000): rc 0 00000020:00000080:2.0:1789127504.213091:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346a0b19000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1789127504.213094:0:15958:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9346a0ab0000), last request at 1789127247 00000020:00000080:2.0:1789127504.213105:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d1ed 00000100:00080000:2.0:1789127504.213109:0:15958:0:(import.c:65:import_set_state_nolock()) ffff9346b707e800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789127504.215283:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1789127504.215456:0:15958:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:2.0:1789127504.215570:0:15958:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9346a0ab0000): rc 0 00000004:00000080:2.0:1789127504.215579:0:15958:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb4b245583ae0 00000100:00080000:2.0:1789127504.215599:0:15958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789127504.215603:0:15958:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1789127504.216349:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127504.219635:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789565312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127504.220101:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789127504.220177:0:15958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789127504.220203:0:15958:0:(import.c:65:import_set_state_nolock()) ffff9346b640b800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789127504.220243:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789565440:0@lo:39:umount.0 00000100:00100000:2.0:1789127504.220297:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127504.220352:0:7745:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789565440 00000100:00100000:2.0:1789127504.220359:0:7745:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789565440 00000100:00100000:2.0:1789127504.220414:0:7745:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789127504.220424:0:7745:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3649:x1876035789565440:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789127504.220451:0:7745:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d279 00000100:00080000:2.0:1789127504.220459:0:7745:0:(import.c:65:import_set_state_nolock()) ffff9346b71ee800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789127504.220480:0:7745:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1789127504.220618:0:7745:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3649:x1876035789565440:12345-0@lo:39:umount.0 Request processed in 195us (320us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789127504.220628:0:7745:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00010000:00010000:2.0:1789127504.220659:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127504.220693:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789564928 00000100:00080000:2.0:1789127504.220702:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346b640b800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789127504.220704:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789564928 00000100:00100000:2.0:1789127504.220715:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789565440:0@lo:39:umount.0 00000100:00100000:1.0:1789127504.220783:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789127504.220795:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e71e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+21:3650:x1876035789564928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127504.220812:0:6507:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127504.220835:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93469a7a0400/0xd718aadfd785d5dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d5d6 expref: 21 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127504.220878:0:6507:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127504.220948:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e71e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:3650:x1876035789564928:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127504.220956:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789127504.225226:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1789127504.225328:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346aecee800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:1.0:1789127504.225369:0:9539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789565312 00000020:00000080:3.0:1789127504.225386:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b7251000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1789127504.225386:0:9539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789565312 00000020:00000080:3.0:1789127504.225413:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346a0b19000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789127504.225435:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346aeced800 for lustre-MDT0000 00000020:00000080:3.0:1789127504.225445:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346b7255800 for lustre-MDT0000 00000020:00000080:3.0:1789127504.225453:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346a0b1a800 for lustre-MDT0000 00000100:00100000:0.0:1789127504.227730:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789564928:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1789127504.227928:0:15958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789127504.227937:0:9539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789127504.227938:0:15958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000100:00100000:1.0:1789127504.227964:0:9539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+20:3653:x1876035789565312:12345-0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1789127504.227965:0:15958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789127504.228036:0:15958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789127504.228057:0:15958:0:(import.c:65:import_set_state_nolock()) ffff934586075800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789127504.228074:0:15958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789127504.228077:0:15958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:2.0:1789127504.228083:0:15958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789127504.228153:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789565568:0@lo:9:umount.0 00010000:00010000:1.0:1789127504.228219:0:9539:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789127504.228220:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789127504.228261:0:9539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934680030200/0xd718aadfd785d09d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d096 expref: 20 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789127504.228279:0:15958:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00010000:00010000:1.0:1789127504.228285:0:9539:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1789127504.228294:0:15958:0:(import.c:65:import_set_state_nolock()) ffff9346b7dd0800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789127504.228347:0:15958:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9346b18f4ed8) has no exports 00000100:00100000:1.0:1789127504.228373:0:9539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2eb81216-4f2e-430c-a0f6-5094c3b40588+19:3653:x1876035789565312:12345-0@lo:103:ldlm_bl.0 Request processed in 419us (3152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127504.228382:0:9539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789127504.228723:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789565696:0@lo:9:umount.0 00000100:00100000:0.0:1789127504.228785:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127504.228994:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789565568 00000100:00100000:3.0:1789127504.229002:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789565568 00000100:00100000:3.0:1789127504.229081:0:8755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789565696 00000100:00100000:3.0:1789127504.229086:0:8755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789565696 00000100:00100000:3.0:1789127504.229134:0:8755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789127504.229154:0:8755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3649:x1876035789565568:12345-0@lo:9:umount.0 00000100:00100000:0.0:1789127504.229162:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789127504.229181:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3649:x1876035789565696:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789127504.229183:0:8755:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d3d7 00000100:00080000:3.0:1789127504.229200:0:8755:0:(import.c:65:import_set_state_nolock()) ffff9345862eb000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1789127504.229207:0:8439:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d50b 00000100:00080000:0.0:1789127504.229224:0:8439:0:(import.c:65:import_set_state_nolock()) ffff934587f7a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127504.229250:0:8755:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000001:00000004:0.0:1789127504.229271:0:8439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789127504.229443:0:8755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3649:x1876035789565568:12345-0@lo:9:umount.0 Request processed in 298us (1222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127504.229720:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3649:x1876035789565696:12345-0@lo:9:umount.0 Request processed in 549us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127504.229729:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789127504.229956:0:8755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:0.0:1789127504.230019:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789127504.230047:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346b7dd0800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789127504.230061:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789127504.230062:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789127504.230066:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789565696:0@lo:9:umount.0 00000100:00080000:0.0:1789127504.230078:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934586075800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789127504.230091:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789127504.230092:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789127504.230095:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789565568:0@lo:9:umount.0 00010000:00010000:0.0:1789127504.230218:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789127504.230788:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127504.230793:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789127504.231108:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789127504.231118:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1789127504.231122:0:7454:0:(genops.c:885:class_export_put()) final put ffff9346b71ef000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789127504.231129:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 62f6ff54-d308-4b3f-88aa-10f2416ee4e9 00000001:00080000:0.0:1789127504.231134:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1789127504.231136:0:7454:0:(genops.c:885:class_export_put()) final put ffff934587f74000/62f6ff54-d308-4b3f-88aa-10f2416ee4e9 00000001:00100000:0.0:1789127504.231140:0:7454:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000001:00080000:0.0:1789127504.231143:0:7454:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1789127504.231145:0:7454:0:(genops.c:885:class_export_put()) final put ffff9346aec83000/2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000001:00100000:0.0:1789127504.231167:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789127504.231170:0:6501:0:(genops.c:885:class_export_put()) final put ffff9346a0ab0000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789127504.231176:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 62f6ff54-d308-4b3f-88aa-10f2416ee4e9 00000001:00080000:0.0:1789127504.231180:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1789127504.231182:0:6501:0:(genops.c:885:class_export_put()) final put ffff934587f78800/62f6ff54-d308-4b3f-88aa-10f2416ee4e9 00000001:00100000:0.0:1789127504.231187:0:6501:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000001:00080000:0.0:1789127504.231190:0:6501:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1789127504.231196:0:6501:0:(genops.c:885:class_export_put()) final put ffff9346aec87000/2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000020:00000080:3.0:1789127504.231785:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b71ef000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1789127504.231833:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff934587f74000/62f6ff54-d308-4b3f-88aa-10f2416ee4e9 for lustre-MDT0001 00000020:00000080:3.0:1789127504.231868:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9346aec83000/2eecd753-97f2-4dc9-9442-17e5ef8fda22 for lustre-MDT0001 00000020:00000080:3.0:1789127504.231903:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9346a0ab0000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000001:00100000:2.0:1789127504.232195:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789127504.232201:0:8433:0:(genops.c:885:class_export_put()) final put ffff9345862ed000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789127504.232306:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789127504.232310:0:9519:0:(genops.c:885:class_export_put()) final put ffff934587f7c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789127504.239090:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff934587f78800/62f6ff54-d308-4b3f-88aa-10f2416ee4e9 for lustre-MDT0000 00000020:00000080:3.0:1789127504.239144:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9346aec87000/2eecd753-97f2-4dc9-9442-17e5ef8fda22 for lustre-MDT0000 00000020:00000080:3.0:1789127504.239185:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346b71ee800 for lustre-MDT0001 00000020:00000080:3.0:1789127504.239192:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934587f76800 for lustre-MDT0001 00000020:00000080:3.0:1789127504.239196:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346aec86000 for lustre-MDT0001 00000020:00000080:3.0:1789127504.239201:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346b707e800 for lustre-MDT0000 00000020:00000080:3.0:1789127504.239204:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9345862ed000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789127504.239230:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff934587f7c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789127504.239247:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934587f79800 for lustre-MDT0000 00000020:00000080:3.0:1789127504.239250:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346aec85000 for lustre-MDT0000 00000020:00000080:3.0:1789127504.239253:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9345862eb000 for lustre-OST0000 00000020:00000080:3.0:1789127504.239258:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934587f7a000 for lustre-OST0001 00000100:00100000:3.0:1789127504.239306:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2eb81216-4f2e-430c-a0f6-5094c3b40588:3653:1876035789565312:0@lo:103:ldlm_bl.0 00000001:00100000:0.0:1789127504.240183:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000020:00000080:0.0:1789127504.240189:0:9519:0:(genops.c:885:class_export_put()) final put ffff934587e11800/2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000001:00100000:2.0:1789127504.241119:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000020:00000080:2.0:1789127504.241124:0:8433:0:(genops.c:885:class_export_put()) final put ffff9345887f1000/2eecd753-97f2-4dc9-9442-17e5ef8fda22 00000020:00000080:1.0:1789127504.243813:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff934587e11800/2eecd753-97f2-4dc9-9442-17e5ef8fda22 for lustre-OST0001 00000020:00000080:1.0:1789127504.243890:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9345887f1000/2eecd753-97f2-4dc9-9442-17e5ef8fda22 for lustre-OST0000 00000020:00000080:1.0:1789127504.243929:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934587e15000 for lustre-OST0001 00000020:00000080:1.0:1789127504.243934:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9345887f1800 for lustre-OST0000 00000020:00080000:2.0:1789127504.250606:0:15958:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9346b18f4ed8) has no exports 00000020:00000080:2.0:1789127504.360258:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d0f1 00000020:00000080:2.0:1789127504.360273:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346a0b1b800/lustre-QMT0000_UUID 00000020:01000000:2.0:1789127504.360294:0:15958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789127504.360362:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9346a0b1b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1789127504.360388:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127504.360401:0:15958:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789127504.360406:0:15958:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9346bea54ed8) has no exports 00000020:00000080:3.0:1789127504.360711:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d0ea 00000020:00000080:3.0:1789127504.360720:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346bea73000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789127504.360779:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9346bea73000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789127504.360800:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789127504.360808:0:15958:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789127504.360812:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346a0b37000/lustre-QMT0000_UUID 00000020:00000080:3.0:1789127504.360814:0:15958:0:(genops.c:844:class_export_destroy()) destroying export ffff9346a0b37000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1789127504.360841:0:15958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1789127504.361029:0:15958:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9345863e9ba0 - data ffff9346b1710ca8/ffff9346aec46c00 00000020:01000000:3.0:1789127504.361197:0:15958:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9346beb82240 - data ffff9346b1574870/ffff9346bebc0800 00000001:00000004:3.0:1789127504.379564:0:15958:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:0.0:1789127504.462393:0:15958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789127504.462419:0:15958:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789127504.462435:0:15958:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff934587896940 x1876035789565440/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789127514 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127504.462478:0:15958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789127504.466768:0:15958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789127504.466775:0:15958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1789127504.466787:0:15958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789127504.466790:0:15958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789127504.468771:0:8753:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789127504.468778:0:8753:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1789127504.468791:0:8753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789127504.473697:0:15958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789127504.473706:0:15958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1789127504.473722:0:15958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789127504.473725:0:15958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789127504.478071:0:9993:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789127504.478080:0:9993:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1789127504.478099:0:9993:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789127504.483939:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d0b9 00000020:00000080:1.0:1789127504.483955:0:15958:0:(genops.c:885:class_export_put()) final put ffff934687663000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789127504.485186:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff934687663000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789127504.489289:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d0ce 00000020:00000080:1.0:1789127504.489304:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346a0b63000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789127504.489331:0:15958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789127504.489337:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789127504.489347:0:15958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789127504.489363:0:15958:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9346b18f1a48) has no exports 00000020:00000080:0.0:1789127504.489550:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9346a0b63000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789127504.489834:0:15958:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789127504.489842:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d504 00000020:00000080:1.0:1789127504.489847:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346aec85800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789127504.489895:0:15958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789127504.489900:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789127504.489924:0:15958:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789127504.489927:0:15958:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff934587f44ed8) has no exports 00000020:00000080:1.0:1789127504.489934:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d4fd 00000020:00000080:1.0:1789127504.489938:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346b7dd1800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789127504.493269:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9346aec85800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789127504.494090:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b7dd1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789127504.494502:0:15958:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789127504.494531:0:15958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789127504.494536:0:15958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1789127504.494542:0:15958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789127504.494544:0:15958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789127504.494586:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127504.494600:0:15958:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789127504.494607:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d3c2 00000020:00000080:1.0:1789127504.494616:0:15958:0:(genops.c:885:class_export_put()) final put ffff9345862ec000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789127504.494620:0:15958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789127504.494627:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789127504.494840:0:15958:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789127504.494845:0:15958:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9346aed19a48) has no exports 00000020:00000080:1.0:1789127504.494852:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d3bb 00000020:00000080:1.0:1789127504.494857:0:15958:0:(genops.c:885:class_export_put()) final put ffff934586072800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789127504.495026:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346b7dd0800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789127504.495035:0:37:0:(genops.c:885:class_export_put()) final put ffff934587b42800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789127504.495038:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff934587b42800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789127504.495043:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789127504.495116:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9345862ec000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789127504.495124:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff934586072800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789127504.495891:0:15958:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789127504.495896:0:15958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789127504.495899:0:15958:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1789127504.495904:0:15958:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789127504.498012:0:15958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789127504.498073:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127504.498086:0:15958:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789127504.498101:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934586075800 for lustre-OST0000-osc-MDT0000 00000004:01000000:1.0:1789127504.498119:0:15958:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1789127504.498125:0:37:0:(genops.c:885:class_export_put()) final put ffff934586eb9800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789127504.498130:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d272 00000020:00000080:0.0:1789127504.498131:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff934586eb9800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789127504.498142:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346b727a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789127504.498147:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789127504.498167:0:15958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789127504.498174:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789127504.498180:0:15958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789127504.498183:0:15958:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9346bea50000) has no exports 00000020:00000080:1.0:1789127504.498190:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d26b 00000020:00000080:0.0:1789127504.498268:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b727a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789127504.499069:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346b6409000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789127504.499937:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b6409000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789127504.528387:0:15958:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789127504.528412:0:15958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789127504.528416:0:15958:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789127504.528424:0:15958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789127504.528506:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346b640b800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1789127504.528547:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127504.528564:0:15958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789127504.528573:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346b707c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789127504.528579:0:15958:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b707c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1789127504.528597:0:15958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789127504.529426:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127504.529433:0:15958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789127504.529436:0:15958:0:(genops.c:885:class_export_put()) final put ffff934687661800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789127504.529439:0:15958:0:(genops.c:844:class_export_destroy()) destroying export ffff934687661800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789127504.529445:0:15958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789127504.529640:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d0d5 00000020:00000080:3.0:1789127504.529653:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346a0b65000/lustre-MDD0000_UUID 00000020:01000000:3.0:1789127504.529671:0:15958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789127504.529679:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127504.529687:0:15958:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789127504.529692:0:15958:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9346a0b5b490) has no exports 00000020:00000080:0.0:1789127504.529710:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346a0b65000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789127504.529731:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789127504.529739:0:15958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789127504.529742:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346b548a000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789127504.529744:0:15958:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b548a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789127504.529751:0:15958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789127504.529922:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d0dc 00000020:00000080:3.0:1789127504.529928:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346a0b67000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789127504.529940:0:15958:0:(tgt_mount.c:187:server_put_mount()) put mount ffff934687bf9800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789127504.529943:0:15958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff934687bf9800 3 00000020:01000004:3.0:1789127504.529947:0:15958:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff934687bf9800 from lustre-MDT0000 00000020:00000080:3.0:1789127504.529969:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789127504.529974:0:15958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789127504.529977:0:15958:0:(genops.c:885:class_export_put()) final put ffff934687665000/lustre-MDT0000_UUID 00000020:00000080:3.0:1789127504.529989:0:15958:0:(genops.c:844:class_export_destroy()) destroying export ffff934687665000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789127504.529997:0:15958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789127504.530033:0:15958:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1789127504.530037:0:15958:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789127504.530041:0:15958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789127504.530043:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127504.530046:0:15958:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789127504.530054:0:15958:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9346901f3800 2eb81216-4f2e-430c-a0f6-5094c3b40588 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127504.530061:0:15958:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9346b1b13490) has exports, disconnecting them 00000020:00000080:0.0:1789127504.530064:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346a0b67000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1789127504.530070:0:15958:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9346901f3800), last request at 1789127225 00000020:00000080:3.0:1789127504.530090:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d07a 00000020:00010000:3.0:1789127504.530094:0:15958:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9346901f3800: total 0 00000100:00080000:3.0:1789127504.530099:0:15958:0:(import.c:65:import_set_state_nolock()) ffff9346901f7000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789127504.530129:0:15958:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9346901f3800): rc 0 00000020:00080000:3.0:1789127504.530133:0:15958:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9346b1b13490) has no exports 00000100:00100000:1.0:1789127504.530333:0:6514:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff934692b65a00:6514] 0 exiting: rc = 1 00000020:00010000:0.0:1789127504.530618:0:6511:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9346901f3800: total 0 00010000:00010000:0.0:1789127504.530680:0:6511:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9346901f3800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789127504.530724:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587fed000/0xd718aadfd785d5eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d5e4 expref: 14 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127504.530743:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934680030000/0xd718aadfd785d184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d17d expref: 13 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127504.530772:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93458858d400/0xd718aadfd785d8b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d8ae expref: 12 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127504.530784:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501a800/0xd718aadfd785d597 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d590 expref: 11 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127504.530794:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501a400/0xd718aadfd785d57b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d574 expref: 10 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127504.530818:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587fed400/0xd718aadfd785d589 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d582 expref: 9 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127504.530829:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346813c8c00/0xd718aadfd785d49b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d494 expref: 8 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127504.530844:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93469a7a0e00/0xd718aadfd785d8c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d8bc expref: 7 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127504.530853:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93469a7a0200/0xd718aadfd785d5a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d59e expref: 6 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127504.530862:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9345886d7400/0xd718aadfd785d8d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d8ca expref: 5 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127504.530872:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501be00/0xd718aadfd785d5b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d5ac expref: 4 pid: 6514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127504.530882:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587fed200/0xd718aadfd785d5c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d5ba expref: 3 pid: 6517 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127504.530895:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934680030400/0xd718aadfd785d176 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd718aadfd785d16f expref: 2 pid: 6516 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127504.530905:0:6511:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9346901f3800, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1789127504.531018:0:6511:0:(genops.c:885:class_export_put()) final put ffff9346901f3800/2eb81216-4f2e-430c-a0f6-5094c3b40588 00010000:00010000:0.0:1789127504.531030:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127504.531032:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127504.531034:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127504.531078:0:6516:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff934692b65800:6516] 1 exiting: rc = 0 00000100:00100000:0.0:1789127504.531170:0:6517:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff934692b64600:6517] 2 exiting: rc = 0 00000020:00000080:3.0:1789127504.531253:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346901f3800/2eb81216-4f2e-430c-a0f6-5094c3b40588 for MGS 00000020:00000080:3.0:1789127504.531288:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346901f7000 for MGS 00000100:00100000:0.0:1789127504.531584:0:14500:0:(service.c:3183:ptlrpc_main()) ll_mgs_0003: service thread [ffff9346aec14800:14500] 3 exiting: rc = 0 00000100:00100000:3.0:1789127504.531707:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531717:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531723:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531729:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531735:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531740:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531746:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531752:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531940:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531949:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531956:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531962:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531969:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531975:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531981:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.531998:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532005:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532011:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532017:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532023:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532028:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532034:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532039:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532044:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532055:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532061:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532066:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532072:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532078:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532085:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532091:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532096:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532102:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532108:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532115:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532122:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532128:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532134:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532140:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532146:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532151:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532156:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532162:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532167:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532172:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532177:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532182:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532188:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532194:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532199:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532212:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532218:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532224:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532229:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532234:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532240:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532247:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532252:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532258:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532265:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532271:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532277:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532284:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127504.532290:0:15958:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:3.0:1789127504.535130:0:15958:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff934587afcae0 - data ffff9346b16ff5e8/ffff9346aec50000 00000020:01000000:3.0:1789127504.535440:0:15958:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9346b9f0c0c0 - data ffff93468215bd80/ffff9346b9def000 00000020:00000080:3.0:1789127504.538328:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d05e 00000020:00000080:3.0:1789127504.538349:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346b1b82800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789127504.538365:0:15958:0:(tgt_mount.c:187:server_put_mount()) put mount ffff934687bf9800 from MGS, refs=2 00000020:01000004:3.0:1789127504.538370:0:15958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff934687bf9800 2 00000020:01000004:3.0:1789127504.538374:0:15958:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff934687bf9800 from MGS 00000020:00000080:3.0:1789127504.538409:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789127504.538425:0:15958:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789127504.538428:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346b1b83800/MGS 00000020:00000080:3.0:1789127504.538432:0:15958:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b1b83800/MGS for MGS 00000020:00000080:0.0:1789127504.538540:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b1b82800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1789127504.538655:0:15958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789127504.538747:0:15958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789127504.538752:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127504.538758:0:15958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789127504.538765:0:15958:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9346bea9b800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127504.538771:0:15958:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9346bea53490) has exports, disconnecting them 00000020:00080000:3.0:1789127504.538776:0:15958:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9346bea9b800), last request at 1789127225 00000020:00000080:3.0:1789127504.538780:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d129 00000020:00080000:3.0:1789127504.538802:0:15958:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9346bea9b800): rc 0 00000020:00000080:3.0:1789127504.538811:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346bea9b800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789127504.538976:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9346bea9b800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789127504.540576:0:15958:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789127504.540584:0:15958:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789127504.540588:0:15958:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789127504.540596:0:15958:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789127504.540623:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346bea9d000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789127504.540866:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127504.540878:0:15958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789127504.540883:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346bea75800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789127504.540887:0:15958:0:(genops.c:844:class_export_destroy()) destroying export ffff9346bea75800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789127504.540893:0:15958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789127504.541166:0:15958:0:(obd_mount.c:710:lustre_put_lsi()) put ffff934687bf9800 1 00000020:00000080:0.0:1789127504.541174:0:15958:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d050 00000020:00000080:0.0:1789127504.541182:0:15958:0:(genops.c:885:class_export_put()) final put ffff9346b1b85800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789127504.541193:0:15958:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789127504.541204:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b1b85800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789127504.541214:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127504.541219:0:15958:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789127504.541223:0:15958:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9346b1b14ed8) has no exports 00000020:00000080:2.0:1789127504.634635:0:15958:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127504.634647:0:15958:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1789127504.634653:0:15958:0:(genops.c:885:class_export_put()) final put ffff934687bff800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789127504.634657:0:15958:0:(genops.c:844:class_export_destroy()) destroying export ffff934687bff800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1789127504.634663:0:15958:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1789127504.634796:0:15958:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff934687bf9000 00000020:02000400:2.0:1789127504.634853:0:15958:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:0.0:1789127504.697006:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789565824:0@lo:400:kworker.0 00000100:00100000:1.0:1789127504.697035:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789565952:0@lo:400:kworker.0 00000100:00100000:3.0:1789127504.697055:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789566080:0@lo:400:kworker.0 00000100:00100000:0.0:1789127504.697134:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127504.697153:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789566208:0@lo:400:kworker.0 00000100:00100000:1.0:1789127504.697177:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789565824 00000100:00100000:1.0:1789127504.697189:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789565824 00000100:00100000:1.0:1789127504.697276:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789127504.697287:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1876035789565824:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789127504.697299:0:6524:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789127504.697697:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127504.697711:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3650:x1876035789565824:12345-0@lo:400:kworker.0 Request processed in 423us (583us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789127504.697720:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789127504.697757:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127504.697784:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789566592:0@lo:400:kworker.0 00000100:00100000:3.0:1789127504.697811:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127504.697843:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789566080 00000100:00100000:3.0:1789127504.697848:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789566080 00000100:00100000:3.0:1789127504.697897:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00080000:0.0:1789127504.697983:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789127504.697989:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9346b707f000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789127504.697994:0:3650:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1789127504.698684:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127504.699029:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789566720:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789127504.699081:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127504.699124:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789566720 00000100:00100000:1.0:1789127504.699131:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789566720 00000100:00100000:1.0:1789127504.699176:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789127504.699186:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789566720:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789127504.699220:0:8442:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789127504.699421:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789566208 00000100:00100000:2.0:1789127504.699442:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789566208 00000100:00100000:1.0:1789127504.699497:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789566720:12345-0@lo:13:osp-pre-1-1.0 Request processed in 311us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127504.699529:0:10363:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789566592 00000100:00100000:2.0:1789127504.699534:0:10363:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789566592 00000100:00100000:1.0:1789127504.699550:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789127504.699567:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789127504.699580:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690406580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789566208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127504.699618:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789566720:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127504.699680:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690406580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789566208:12345-0@lo:400:kworker.0 Request processed in 99us (1983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127504.699689:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789127504.699708:0:10363:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789127504.699714:0:10363:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7396940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789566592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127504.699748:0:10363:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7396940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789566592:12345-0@lo:400:kworker.0 Request processed in 34us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127504.699754:0:10363:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789127504.700092:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690405a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789566592:0@lo:400:kworker.0 00000100:00080000:2.0:1789127504.701082:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127504.701091:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127504.701094:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127504.701433:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789566080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127504.701564:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789566080:12345-0@lo:400:kworker.0 Request processed in 3657us (3803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127504.701575:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00010000:00080000:3.0:1789127504.701672:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ee5e00 x1876035789566080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127504.701688:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789566080:0@lo:400:kworker.0 00000100:00100000:3.0:1789127504.701747:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789566208:0@lo:400:kworker.0 00000100:00100000:1.0:1789127504.702032:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127504.702112:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789566464:0@lo:400:kworker.0 00000100:00100000:1.0:1789127504.702154:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127504.702180:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127504.702188:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789566336:0@lo:400:kworker.0 00000100:00100000:1.0:1789127504.702212:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127504.702888:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789565952 00000100:00100000:1.0:1789127504.703163:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789565952 00000100:00100000:1.0:1789127504.703215:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789566464 00000100:00100000:1.0:1789127504.703219:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789566464 00000100:00100000:1.0:1789127504.703885:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789566336 00000100:00100000:1.0:1789127504.703902:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789566336 00000100:00100000:1.0:1789127504.703932:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1789127504.703944:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789566464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127504.704040:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789566464:12345-0@lo:400:kworker.0 Request processed in 98us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127504.704047:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:1.0:1789127504.704068:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789127504.704072:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1876035789565952:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789127504.704079:0:9447:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789127504.704107:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1876035789565952:12345-0@lo:400:kworker.0 Request processed in 33us (2077us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789127504.704113:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789127504.704145:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789127504.704150:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1876035789566336:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789127504.704156:0:9447:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789127504.704184:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3651:x1876035789566336:12345-0@lo:400:kworker.0 Request processed in 33us (1972us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789127504.704190:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1789127504.704209:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127504.704243:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789127504.704249:0:3651:0:(import.c:65:import_set_state_nolock()) ffff934587b5d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789127504.704253:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789127504.704259:0:3651:0:(import.c:65:import_set_state_nolock()) ffff934587b5d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127504.704264:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 257 00000100:00080000:1.0:1789127504.704271:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff934587b5d800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789127504.704845:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ff83c0 x1876035789566848/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127504.704886:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3651:1876035789566336:0@lo:400:kworker.0 00010000:00080000:1.0:1789127504.704987:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346904070c0 x1876035789566464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127504.705000:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789566464:0@lo:400:kworker.0 00000100:00080000:1.0:1789127504.705013:0:3651:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789127504.705017:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9345862ed800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789127504.705021:0:3651:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789127504.705025:0:3651:0:(import.c:65:import_set_state_nolock()) ffff9345862ed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127504.705028:0:3651:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 233 00000100:00080000:1.0:1789127504.705043:0:3651:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9345862ed800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789127504.705060:0:3651:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ffad00 x1876035789566976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127504.705072:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789565952:0@lo:400:kworker.0 00000100:00100000:2.0:1789127504.707700:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1876035789566848:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789127504.707778:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127504.707846:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1876035789566976:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789127504.707850:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789566848 00000100:00100000:3.0:1789127504.707865:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789566848 00000100:00100000:2.0:1789127504.707872:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127504.707930:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789566976 00000100:00100000:2.0:1789127504.707937:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789566976 00000100:00100000:3.0:1789127504.707943:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789127504.707955:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1876035789566848:12345-0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789127504.707975:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789127504.707983:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1876035789566976:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:3.0:1789127504.707987:0:9447:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00020000:2.0:1789127504.708011:0:6524:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789127504.708995:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1876035789566848:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 1033us (1209us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789127504.709015:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789127504.715117:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1876035789566976:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 7124us (7236us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789127504.715150:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:2.0:1789127504.715238:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934587b5d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127504.715244:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127504.715248:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1876035789566848:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1789127504.715264:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9345862ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127504.715267:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127504.715270:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1876035789566976:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1789127504.716715:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9346b707f000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127504.716726:0:3650:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 209 00000100:00080000:0.0:1789127504.716734:0:3650:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9346b707f000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789127504.716772:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ebda40 x1876035789567104/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127504.716805:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789565824:0@lo:400:kworker.0 00000100:00100000:1.0:1789127504.716868:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876035789567104:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789127504.716986:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127504.717412:0:9447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789567104 00000100:00100000:0.0:1789127504.717422:0:9447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789567104 00000100:00100000:0.0:1789127504.717469:0:9447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789127504.717477:0:9447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1876035789567104:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1789127504.717498:0:9447:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789127504.717640:0:9447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3649:x1876035789567104:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 161us (654us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789127504.717648:0:9447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1789127504.717685:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346b707f000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127504.717698:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789127504.717704:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876035789567104:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:0.0:1789127504.823669:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127505.208180:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789567232:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127505.208269:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127505.208486:0:11955:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789567232 00000100:00100000:2.0:1789127505.208494:0:11955:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789567232 00000100:00100000:2.0:1789127505.208574:0:11955:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789127505.208584:0:11955:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7397840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789567232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789127505.208622:0:11955:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789127505.208669:0:11955:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7397840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789567232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127505.208677:0:11955:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789127505.208723:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789567232:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789127505.851280:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127506.876018:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127507.898845:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789127508.421681:0:16159:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789127508.431974:0:16159:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1789127508.432025:0:16159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.432039:0:16159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.432046:0:16159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.432053:0:16159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.432079:0:16159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789127508.432084:0:16159:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789127508.432109:0:16159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789127508.432113:0:16159:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789127508.432119:0:16159:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789127508.432128:0:16159:0:(import.c:65:import_set_state_nolock()) ffff9346b707f000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789127508.432133:0:16159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789127508.432134:0:16159:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789127508.432137:0:16159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789127508.433081:0:16159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433111:0:16159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433118:0:16159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433124:0:16159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433137:0:16159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789127508.433142:0:16159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433149:0:16159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433155:0:16159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433161:0:16159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433171:0:16159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1789127508.433176:0:16159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433182:0:16159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433198:0:16159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433204:0:16159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433213:0:16159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1789127508.433218:0:16159:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934680031e00/0xd718aadfd785d17d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433224:0:16159:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934680031e00/0xd718aadfd785d17d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433230:0:16159:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934680031e00/0xd718aadfd785d17d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433236:0:16159:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff934680031e00/0xd718aadfd785d17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127508.433243:0:16159:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1789127508.433246:0:16159:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1789127508.433274:0:16159:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1789127508.433278:0:16159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1789127508.433283:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127508.433288:0:16159:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789127508.433296:0:16159:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9346b7dd4000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127508.433301:0:16159:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9346aecbc000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127508.433306:0:16159:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9346a0b59a48) has exports, disconnecting them 00000020:00080000:3.0:1789127508.433317:0:16159:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9346b7dd4000), last request at 1789127504 00000020:00000080:3.0:1789127508.433324:0:16159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d45c 00000100:00080000:3.0:1789127508.433340:0:16159:0:(import.c:65:import_set_state_nolock()) ffff9346b7dd5000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789127508.433379:0:16159:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9346b7dd4000): rc 0 00000020:00000080:3.0:1789127508.433381:0:16159:0:(genops.c:885:class_export_put()) final put ffff9346b7dd4000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1789127508.433389:0:16159:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9346aecbc000), last request at 1789127504 00000020:00000080:3.0:1789127508.433392:0:16159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d336 00000100:00080000:3.0:1789127508.433397:0:16159:0:(import.c:65:import_set_state_nolock()) ffff9346aecb9800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789127508.433403:0:16159:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9346aecbc000): rc 0 00000020:00000080:3.0:1789127508.433405:0:16159:0:(genops.c:885:class_export_put()) final put ffff9346aecbc000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1789127508.433411:0:16159:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb4b241653ae0 00000100:00080000:3.0:1789127508.433427:0:16159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789127508.433430:0:16159:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1789127508.433714:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789127508.433724:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.433733:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0800 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127508.433738:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.433748:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127508.433767:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127508.433774:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789127508.433777:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789127508.433779:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789127508.433815:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.433822:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127508.433928:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.433936:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a0800/0xd718aadfd785d5ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d5b3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.433948:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789127508.433952:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.433957:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed600 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127508.433960:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.433967:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127508.433973:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127508.433988:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789127508.433991:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:0.0:1789127508.433993:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:0.0:1789127508.434012:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.434018:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127508.434035:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127508.434043:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789127508.434043:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934587fed600/0xd718aadfd785d5ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d5c1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127508.434052:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.434057:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127508.434063:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127508.434065:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0000 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127508.434071:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.434076:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1800 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127508.434081:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127508.434085:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.434095:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127508.434097:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127508.434110:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789127508.434116:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:00010000:0.0:1789127508.434118:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127508.434119:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:2.0:1789127508.434125:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789567360:0@lo:103:ldlm_bl.0 10000000:01000000:0.0:1789127508.434125:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789127508.434129:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789127508.434132:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789127508.434159:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.434166:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127508.434173:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.434180:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a1800/0xd718aadfd785d8ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d8d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.434190:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127508.434193:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff934680031e00/0xd718aadfd785d17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.434199:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934680031e00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127508.434202:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff934680031e00/0xd718aadfd785d17d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.434209:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934680031e00/0xd718aadfd785d17d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127508.434215:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934680031e00/0xd718aadfd785d17d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127508.434221:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789127508.434224:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789127508.434226:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789127508.434237:0:6511:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff934680031e00/0xd718aadfd785d17d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.434243:0:6511:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127508.434248:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff934680031e00/0xd718aadfd785d17d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127508.434259:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934680031e00/0xd718aadfd785d17d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d184 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127508.434267:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127508.434272:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127508.434273:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127508.434275:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789127508.434280:0:16159:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789127508.434287:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789567872:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789127508.434299:0:16159:0:(import.c:65:import_set_state_nolock()) ffff934687665800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789127508.434319:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127508.434340:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789567360 00000100:00100000:2.0:1789127508.434346:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789567360 00000100:00100000:0.0:1789127508.434349:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789567488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127508.434371:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127508.434395:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789567872 00000100:00100000:2.0:1789127508.434398:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789567872 00000100:00100000:0.0:1789127508.434400:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127508.434405:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789567744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127508.434408:0:6507:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789567488 00000100:00100000:2.0:1789127508.434410:0:6507:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789567488 00000100:00100000:2.0:1789127508.434420:0:6507:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789127508.434426:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127508.434427:0:6507:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587894780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1876035789567360:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789127508.434439:0:6507:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789127508 with bad export cookie 15499325995965862010 00000100:00100000:0.0:1789127508.434446:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789567744 00000100:00100000:0.0:1789127508.434449:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789567744 00000100:00100000:0.0:1789127508.434464:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789127508.434469:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690400000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1876035789567872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789127508.434473:0:6509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789127508 with bad export cookie 15499325995965862010 00000100:00100000:0.0:1789127508.434534:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690400000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3650:x1876035789567872:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (214us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789127508.434542:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789127508.434559:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789127508.434562:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346a9c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3652:x1876035789567488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789127508.434565:0:6509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789127508 with bad export cookie 15499325995965862010 00000100:00100000:0.0:1789127508.434594:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346a9c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3652:x1876035789567488:12345-0@lo:103:ldlm_bl.0 Request processed in 30us (222us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789127508.434607:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1789127508.434612:0:6510:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127508.434622:0:6510:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789127508.434623:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789127508.434630:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690400b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3652:x1876035789567744:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789127508.434636:0:6509:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789127508 with bad export cookie 15499325995965862010 00010000:00010000:1.0:1789127508.434638:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127508.434647:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a0000/0xd718aadfd785d494 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd718aadfd785d49b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127508.434663:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127508.434665:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127508.434669:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127508.434669:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690400b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3652:x1876035789567744:12345-0@lo:103:ldlm_bl.0 Request processed in 37us (240us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789127508.434678:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:1.0:1789127508.434679:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789127508.434689:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b7dd4000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00080000:0.0:1789127508.434720:0:3650:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789127508.434724:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9346b5488800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1789127508.434728:0:3650:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.148@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00000080:1.0:1789127508.434782:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346aecbc000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1789127508.434807:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346b7dd5000 for lustre-MDT0001 00000020:00000080:1.0:1789127508.434812:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346aecb9800 for lustre-MDT0001 00000100:00100000:1.0:1789127508.434825:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7395a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789568000:0@lo:39:umount.0 00000100:00100000:1.0:1789127508.434857:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127508.436566:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789568000 00000100:00100000:1.0:1789127508.436575:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789568000 00000100:00100000:1.0:1789127508.436620:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1789127508.436628:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1876035789568000:12345-0@lo:39:umount.0 00000020:00080000:1.0:1789127508.436637:0:6527:0:(tgt_handler.c:807:tgt_request_handle()) operation 39 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789127508.436694:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1876035789568000:12345-0@lo:39:umount.0 Request processed in 65us (1836us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789127508.436702:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:1.0:1789127508.436753:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934687665800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789127508.436761:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7395a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789568000:0@lo:39:umount.0 00000100:00080000:3.0:1789127508.437028:0:16159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789127508.437032:0:16159:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:3.0:1789127508.437086:0:16159:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789127508.437224:0:16159:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789127508.437245:0:16159:0:(import.c:65:import_set_state_nolock()) ffff934586ebe000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789127508.437260:0:16159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789127508.437262:0:16159:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:3.0:1789127508.437271:0:16159:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789127508.437327:0:16159:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789127508.437336:0:16159:0:(import.c:65:import_set_state_nolock()) ffff93458621d800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789127508.437358:0:16159:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9346a0b59a48) has no exports 00000100:00100000:1.0:1789127508.437599:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789568128:0@lo:9:umount.0 00000100:00100000:1.0:1789127508.437642:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127508.437823:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789568256:0@lo:9:umount.0 00000100:00100000:1.0:1789127508.437848:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127508.438011:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789568128 00000100:00100000:3.0:1789127508.438017:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789568128 00000100:00100000:3.0:1789127508.438106:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789568256 00000100:00100000:3.0:1789127508.438111:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789568256 00000100:00080000:1.0:1789127508.438142:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127508.438216:0:6518:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127508.438301:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789127508.438311:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876035789568128:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789127508.438334:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d38a 00000100:00080000:3.0:1789127508.438342:0:8438:0:(import.c:65:import_set_state_nolock()) ffff934586ebf000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127508.438397:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789127508.438546:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3649:x1876035789568128:12345-0@lo:9:umount.0 Request processed in 238us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127508.438554:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789127508.438569:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789127508.438577:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3649:x1876035789568256:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789127508.438588:0:8438:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d4c5 00000100:00080000:3.0:1789127508.438593:0:8438:0:(import.c:65:import_set_state_nolock()) ffff934587b5c000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789127508.438614:0:8438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789127508.438684:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3649:x1876035789568256:12345-0@lo:9:umount.0 Request processed in 109us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127508.438690:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789127508.438807:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934586ebe000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789127508.438854:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789127508.438929:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789127508.438942:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73952c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789568128:0@lo:9:umount.0 00000100:00080000:1.0:1789127508.438957:0:3649:0:(import.c:65:import_set_state_nolock()) ffff93458621d800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789127508.438965:0:3649:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789127508.438966:0:3649:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789127508.438969:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789568256:0@lo:9:umount.0 00010000:00010000:1.0:1789127508.438992:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789127508.439594:0:3652:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.148@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789127508.444980:0:3650:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.148@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1789127508.444985:0:3650:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789127508.444993:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9346b72ab480 x1876035789567360/t0(0) o103->MGC192.168.206.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789127524 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127508.445007:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9346b72aad00 x1876035789567872/t0(0) o103->MGC192.168.206.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789127524 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127508.445016:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9346b72aa580 x1876035789567488/t0(0) o103->MGC192.168.206.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789127524 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127508.445025:0:3650:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9346b72a92c0 x1876035789567744/t0(0) o103->MGC192.168.206.148@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789127524 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789127508.445039:0:3652:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9346b5488800 already not connected (conn 1, was 1): DISCONN 10000000:01000000:0.0:1789127508.445040:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789127508.445045:0:3650:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789127508.445048:0:3650:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789127508.445052:0:3650:0:(import.c:65:import_set_state_nolock()) ffff9346b5488800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127508.445057:0:3650:0:(import.c:510:import_select_connection()) MGC192.168.206.148@tcp: connect to NID 0@lo last attempt 186 00000100:00100000:1.0:1789127508.445067:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789567488:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1789127508.445068:0:3650:0:(import.c:624:import_select_connection()) MGC192.168.206.148@tcp: import ffff9346b5488800 using connection 192.168.206.148@tcp/0@lo 00010000:00010000:0.0:1789127508.445092:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127508.445102:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2eb81216-4f2e-430c-a0f6-5094c3b40588:3652:1876035789567744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127508.445228:0:3650:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934690402580 x1876035789568384/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127508.445264:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690402580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2eb81216-4f2e-430c-a0f6-5094c3b40588:3649:1876035789568384:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1789127508.445310:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876035789568384 offset 0 length 520: 4 00000100:00100000:0.0:1789127508.445365:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:3650:1876035789567872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127508.445378:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127508.445385:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2eb81216-4f2e-430c-a0f6-5094c3b40588:0:1876035789567616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127508.445727:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2eb81216-4f2e-430c-a0f6-5094c3b40588:3651:1876035789567360:0@lo:103:ldlm_bl.0 00000400:00000100:2.0:1789127508.451543:0:6507:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1876035789567360 offset 224 length 224: 4 00000100:00100000:2.0:1789127508.451571:0:6507:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587894780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3651:x1876035789567360:12345-0@lo:103:ldlm_bl.0 Request processed in 17142us (17302us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789127508.451585:0:6507:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000020:00080000:3.0:1789127508.457948:0:16159:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9346a0b59a48) has no exports 00000020:01000000:2.0:1789127508.487978:0:16159:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9345863e9000 - data ffff9346b1710bd0/ffff9346aec44c00 00000020:01000000:2.0:1789127508.488126:0:16159:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9346b70bca80 - data ffff9346b160f288/ffff9346b6601c00 00000001:00000004:1.0:1789127508.517135:0:16159:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1789127508.574393:0:16159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789127508.574401:0:16159:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789127508.574408:0:16159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789127508.580491:0:16159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789127508.580499:0:16159:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1789127508.580533:0:16159:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789127508.580536:0:16159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789127508.582438:0:8747:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789127508.582446:0:8747:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1789127508.582462:0:8747:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789127508.588829:0:16159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789127508.588836:0:16159:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:2.0:1789127508.588858:0:16159:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789127508.588861:0:16159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789127508.589408:0:9989:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789127508.589414:0:9989:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1789127508.589435:0:9989:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789127508.592298:0:16159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d1a0 00000020:00000080:2.0:1789127508.592309:0:16159:0:(genops.c:885:class_export_put()) final put ffff9346b668e800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789127508.592486:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b668e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789127508.594583:0:16159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d1b5 00000020:00000080:2.0:1789127508.594595:0:16159:0:(genops.c:885:class_export_put()) final put ffff9346b6689800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789127508.594612:0:16159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789127508.594618:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127508.594626:0:16159:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789127508.594630:0:16159:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9346a0b58000) has no exports 00000020:00000080:1.0:1789127508.594720:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b6689800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:2.0:1789127508.594855:0:16159:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789127508.594863:0:16159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d4be 00000020:00000080:2.0:1789127508.594867:0:16159:0:(genops.c:885:class_export_put()) final put ffff934587b41800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789127508.594883:0:16159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789127508.594903:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127508.594910:0:16159:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789127508.594913:0:16159:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff934587ddb490) has no exports 00000020:00000080:2.0:1789127508.594918:0:16159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d4b7 00000020:00000080:2.0:1789127508.594923:0:16159:0:(genops.c:885:class_export_put()) final put ffff93458621a000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789127508.594926:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff934587b41800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789127508.594978:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff93458621a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789127508.595399:0:16159:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789127508.595404:0:16159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789127508.595408:0:16159:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:2.0:1789127508.595413:0:16159:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789127508.595415:0:16159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789127508.595461:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127508.595468:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff93458621d800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789127508.595470:0:16159:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789127508.595477:0:38:0:(genops.c:885:class_export_put()) final put ffff934587b43000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789127508.595478:0:16159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d37c 00000020:00000080:1.0:1789127508.595483:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff934587b43000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789127508.595486:0:16159:0:(genops.c:885:class_export_put()) final put ffff934586ebc800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1789127508.595489:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1789127508.595492:0:16159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789127508.595497:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127508.595501:0:16159:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789127508.595504:0:16159:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9346aeec9a48) has no exports 00000020:00000080:2.0:1789127508.595530:0:16159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d375 00000020:00000080:2.0:1789127508.595533:0:16159:0:(genops.c:885:class_export_put()) final put ffff934586ebb800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789127508.595598:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff934586ebc800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789127508.595608:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff934586ebb800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789127508.598477:0:16159:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789127508.598485:0:16159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789127508.598489:0:16159:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:2.0:1789127508.598497:0:16159:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789127508.598499:0:16159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789127508.598565:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127508.598570:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934586ebe000 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1789127508.598577:0:16159:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789127508.598584:0:16159:0:(genops.c:885:class_export_put()) final put ffff934586074800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789127508.598588:0:16159:0:(genops.c:844:class_export_destroy()) destroying export ffff934586074800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1789127508.598595:0:16159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789127508.599007:0:16159:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789127508.599025:0:16159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d1d8 00000020:00000080:2.0:1789127508.599129:0:16159:0:(genops.c:885:class_export_put()) final put ffff934687664800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789127508.599147:0:16159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='') 00000020:00000080:2.0:1789127508.599152:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127508.599157:0:16159:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789127508.599161:0:16159:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9346b1b10000) has no exports 00000020:00000080:2.0:1789127508.599167:0:16159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d1d1 00000020:00000080:2.0:1789127508.599171:0:16159:0:(genops.c:885:class_export_put()) final put ffff934687662000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789127508.599224:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff934687664800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789127508.599237:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff934687662000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789127508.636448:0:16159:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789127508.636457:0:16159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789127508.636461:0:16159:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1789127508.636468:0:16159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789127508.636542:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127508.636549:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934687665800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1789127508.636555:0:16159:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789127508.636560:0:36:0:(genops.c:885:class_export_put()) final put ffff934687660800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789127508.636563:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff934687660800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789127508.636573:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789127508.636581:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127508.636583:0:16159:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789127508.636586:0:16159:0:(genops.c:885:class_export_put()) final put ffff9346a0b66800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789127508.636588:0:16159:0:(genops.c:844:class_export_destroy()) destroying export ffff9346a0b66800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789127508.636596:0:16159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789127508.639314:0:16159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d1bc 00000020:00000080:0.0:1789127508.639329:0:16159:0:(genops.c:885:class_export_put()) final put ffff9346b6689000/lustre-MDD0001_UUID 00000020:01000000:0.0:1789127508.639350:0:16159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789127508.639359:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127508.639381:0:16159:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789127508.639385:0:16159:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9346a0b5ced8) has no exports 00000020:00000080:0.0:1789127508.639410:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127508.639415:0:16159:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789127508.639419:0:16159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d1c3 00000020:00000080:0.0:1789127508.639423:0:16159:0:(genops.c:885:class_export_put()) final put ffff9346b668f800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789127508.639430:0:16159:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9346b640b000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789127508.639432:0:16159:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9346b640b000 2 00000020:00000080:1.0:1789127508.639435:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b6689000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000004:0.0:1789127508.639435:0:16159:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9346b640b000 from lustre-MDT0001 00000020:00000080:1.0:1789127508.639439:0:36:0:(genops.c:885:class_export_put()) final put ffff9346b6688000/lustre-MDD0001_UUID 00000020:00000080:1.0:1789127508.639441:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b6688000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789127508.639446:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1789127508.639459:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127508.639463:0:16159:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789127508.639466:0:16159:0:(genops.c:885:class_export_put()) final put ffff9346b668b000/lustre-MDT0001_UUID 00000020:00000080:0.0:1789127508.639468:0:16159:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b668b000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789127508.639476:0:16159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1789127508.639505:0:16159:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789127508.639522:0:16159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789127508.639525:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127508.639528:0:16159:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789127508.639534:0:16159:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9346b707b000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789127508.639539:0:16159:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9346b1b11a48) has exports, disconnecting them 00000020:00080000:0.0:1789127508.639543:0:16159:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9346b707b000), last request at 1789127247 00000020:00000080:0.0:1789127508.639547:0:16159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d217 00000020:00080000:0.0:1789127508.639556:0:16159:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9346b707b000): rc 0 00000020:00000080:0.0:1789127508.639559:0:16159:0:(genops.c:885:class_export_put()) final put ffff9346b707b000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789127508.639642:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b668f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789127508.639646:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b707b000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789127508.641656:0:16159:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789127508.641664:0:16159:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789127508.641668:0:16159:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789127508.641673:0:16159:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789127508.642349:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127508.642357:0:16159:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789127508.642365:0:16159:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9346b640b000 1 00000020:00000080:0.0:1789127508.642382:0:16159:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d153 00000020:00000080:0.0:1789127508.642390:0:16159:0:(genops.c:885:class_export_put()) final put ffff9346a0b18800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1789127508.642395:0:16159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789127508.642399:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127508.642403:0:16159:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789127508.642407:0:16159:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9346b64fced8) has no exports 00000020:00000080:2.0:1789127508.649127:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346b707f000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1789127508.649141:0:36:0:(genops.c:885:class_export_put()) final put ffff9346b707f800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1789127508.649145:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b707f800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1789127508.649152:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1789127508.649223:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346a0b18800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789127508.681538:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789127508.681552:0:16159:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789127508.681557:0:16159:0:(genops.c:885:class_export_put()) final put ffff9346b640e800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789127508.681562:0:16159:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b640e800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789127508.681570:0:16159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789127508.681676:0:16159:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9346b640d800 00000020:01000000:0.0:1789127508.681694:0:16159:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789127508.681698:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789127508.681702:0:16159:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789127508.681705:0:16159:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9346b18f0000) has no exports 00000100:00100000:0.0:1789127508.681780:0:9447:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9346aec15c00:9447] 3 exiting: rc = 0 00000100:00100000:1.0:1789127508.681940:0:6522:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff934698cf9e00:6522] 0 exiting: rc = 1 00000100:00100000:2.0:1789127508.682038:0:6524:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9346b1ceb000:6524] 2 exiting: rc = 0 00000100:00100000:3.0:1789127508.682191:0:6523:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9346b1cea600:6523] 1 exiting: rc = 0 00000100:00100000:0.0:1789127508.682800:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682809:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682815:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682830:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682837:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682842:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682848:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682853:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682859:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682865:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682870:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682876:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682881:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682897:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682903:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682908:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682914:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682928:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682934:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682941:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682946:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682951:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682957:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682962:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682967:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682973:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682978:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682984:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.682996:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683002:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683007:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683012:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683025:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683031:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683037:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683043:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683049:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683054:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683060:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683065:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683071:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683077:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683082:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683088:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683093:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683099:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683104:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683109:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683115:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683120:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683125:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683131:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683143:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683148:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683153:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683159:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683163:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683174:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683180:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683186:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683191:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683197:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683418:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.683425:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.686865:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9346b1b1f800:6525] 0 exiting: rc = 1 00000100:00100000:3.0:1789127508.687146:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9346b1b1f000:6526] 1 exiting: rc = 0 00000100:00100000:1.0:1789127508.687451:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687461:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687468:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687475:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687481:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687487:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687493:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687499:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687546:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687552:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687558:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687565:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687571:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687577:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687582:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687588:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687594:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687599:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687604:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687610:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687616:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687622:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687627:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687632:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687638:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687643:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687649:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687655:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687660:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687665:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687670:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687675:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687681:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687686:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687692:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687696:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687702:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687706:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687711:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687716:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687721:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687727:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687732:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687744:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687749:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687754:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687760:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687764:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687770:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687776:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687780:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687785:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687790:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687796:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687801:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687806:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687810:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687815:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687821:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687826:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687831:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687836:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687841:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.687847:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.688253:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9346b1b9f200:6527] 0 exiting: rc = 1 00000100:00100000:1.0:1789127508.688332:0:7745:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9346b721e600:7745] 2 exiting: rc = 0 00000100:00100000:2.0:1789127508.688505:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9346b1b9ee00:6528] 1 exiting: rc = 0 00000100:00100000:1.0:1789127508.689281:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689289:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689297:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689304:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689310:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689315:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689321:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689340:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689362:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689368:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689375:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689381:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689394:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689400:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689405:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689411:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689417:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689423:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689429:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689448:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689456:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689462:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689468:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689473:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689479:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689484:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689490:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689496:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.689502:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690269:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690279:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690298:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690305:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690311:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690316:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690322:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690328:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690334:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690339:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690432:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690440:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690445:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690451:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690471:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690477:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690482:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690488:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690501:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690506:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690555:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690561:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690567:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690573:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690578:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690585:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690605:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690613:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690620:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690626:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690631:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690639:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690645:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690651:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127508.690664:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.702137:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff934684b95000:6529] 0 exiting: rc = 1 00000100:00100000:2.0:1789127508.702238:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9346c1ad2600:6530] 1 exiting: rc = 0 00000100:00100000:0.0:1789127508.702455:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702462:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702466:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702471:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702475:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702480:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702485:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702489:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702494:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702498:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702504:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702535:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702541:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702546:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702552:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702557:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702562:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702567:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702572:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702578:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702583:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702588:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702593:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702609:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702614:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702620:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702625:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702629:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702634:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702639:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702644:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702650:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702655:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702661:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702667:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702674:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702679:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702685:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702691:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702696:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702702:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702707:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702713:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702718:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702722:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702728:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702733:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702739:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702744:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702750:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702756:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702761:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702767:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702772:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702778:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702784:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702789:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702795:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702808:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702813:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702819:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702825:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702830:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.702836:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703173:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9346b9c13200:6532] 1 exiting: rc = 0 00000100:00100000:2.0:1789127508.703718:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9346b9c12e00:6531] 0 exiting: rc = 1 00000100:00100000:0.0:1789127508.703810:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703817:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703822:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703827:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703833:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703840:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703846:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703852:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703857:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703863:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703868:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703873:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703879:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703884:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703900:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703907:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703911:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703916:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703921:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703925:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703930:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703935:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703941:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703946:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703950:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703956:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703962:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703967:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703982:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703988:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703993:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.703999:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704004:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704009:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704014:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704020:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704025:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704030:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704035:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704040:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704045:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704051:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704056:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704061:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704066:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704072:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704077:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704082:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704088:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704093:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704097:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704102:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704107:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704111:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704116:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704122:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704127:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704132:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704137:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704142:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704148:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704153:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704159:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704171:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704660:0:6534:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9346b9c13600:6534] 1 exiting: rc = 0 00000100:00100000:2.0:1789127508.704787:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9346b9c12600:6533] 0 exiting: rc = 1 00000100:00100000:0.0:1789127508.704991:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.704997:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705003:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705009:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705014:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705019:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705025:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705031:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705036:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705041:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705047:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705051:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705056:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705061:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705066:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705071:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705076:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705081:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705086:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705091:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705095:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705101:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705106:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705112:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705117:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705122:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705127:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705133:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705138:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705143:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705149:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705154:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705158:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705172:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705178:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705184:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705189:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705194:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705210:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705216:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705221:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705226:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705231:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705237:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705243:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705247:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705252:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705257:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705262:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705267:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705271:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705276:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705280:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705284:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705289:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705294:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705299:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705303:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705308:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705313:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705318:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705323:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705328:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127508.705332:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.706633:0:6535:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9346c1ad2800:6535] 0 exiting: rc = 1 00000100:00100000:0.0:1789127508.706986:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff934688ba3c00:6537] 2 exiting: rc = 0 00000100:00100000:1.0:1789127508.707432:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9346b18fe600:6536] 1 exiting: rc = 0 00000100:00100000:2.0:1789127508.707552:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707561:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707567:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707572:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707578:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707584:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707589:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707594:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707601:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707620:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707638:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707643:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707648:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707655:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707661:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707666:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707672:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707678:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707683:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707688:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707694:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707699:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707705:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707710:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707716:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707722:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707727:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707733:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707738:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707744:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707749:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707754:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707760:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707779:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707787:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707793:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707800:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707806:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707812:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707818:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707824:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707829:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707835:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707840:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707845:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707857:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707862:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707868:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707874:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707880:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707897:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707904:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707911:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707918:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707923:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707930:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707936:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707941:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707946:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.707952:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.708196:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.708275:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.708281:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127508.708295:0:16159:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789127508.712786:0:16159:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127508.712799:0:16159:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789127508.712805:0:16159:0:(genops.c:885:class_export_put()) final put ffff9346b548f800/MDS_uuid 00000020:00000080:2.0:1789127508.712809:0:16159:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b548f800/MDS_uuid for MDS 00000020:01000000:2.0:1789127508.712816:0:16159:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789127508.712990:0:16159:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:1.0:1789127508.921446:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789127509.816437:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789127509.816446:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789127509.816450:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789127509.816454:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789127509.816458:0:36:0:(import.c:65:import_set_state_nolock()) ffff9345862ed800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127509.816466:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 465 00000100:00080000:1.0:1789127509.816471:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789127509.816480:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9345862ed800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789127509.816557:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ffb840 x1876035789568512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127509.816614:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789127509.816624:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789127509.816626:0:36:0:(import.c:65:import_set_state_nolock()) ffff934587b5d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127509.816630:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 465 00000100:00080000:1.0:1789127509.816634:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789127509.816638:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff934587b5d800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789127509.816651:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ff8000 x1876035789568768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127509.816688:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789568896:0@lo:400:kworker.0 00000100:00100000:2.0:1789127509.816710:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1876035789568512:0@lo:38:kworker.0 00000400:00000100:1.0:1789127509.816739:0:3653:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035789568896 offset 0 length 224: 4 00000400:00000100:2.0:1789127509.816744:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035789568512 offset 0 length 520: 4 00000100:00100000:2.0:1789127509.816792:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1876035789568768:0@lo:38:kworker.0 00000100:00100000:3.0:1789127509.816895:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789568640:0@lo:400:kworker.0 00000400:00000100:2.0:1789127509.818285:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035789568768 offset 0 length 520: 4 00000400:00000100:3.0:1789127509.823116:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035789568640 offset 0 length 224: 4 00010000:00010000:1.0:1789127509.943734:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127510.968305:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127511.993196:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789127512.824732:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789127512.824741:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127512.824757:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789127512.824760:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127512.824815:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789127512.824820:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789127512.824855:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690402940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789569152:0@lo:400:kworker.0 00000400:00000100:0.0:1789127512.824921:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035789569152 offset 0 length 224: 4 00000100:00100000:0.0:1789127512.824968:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127512.824974:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789569024:0@lo:400:kworker.0 00000400:00000100:0.0:1789127512.824992:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035789569024 offset 0 length 224: 4 00000020:01000004:2.0:1789127512.842157:0:16359:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1789127512.857503:0:16359:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789127512.857752:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d597 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127512.857768:0:16359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d597 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127512.857775:0:16359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d597 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127512.857782:0:16359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d597 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127512.857836:0:16359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789127512.857843:0:16359:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789127512.857940:0:16359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789127512.857951:0:16359:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff934587ffb840 x1876035789568512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127524 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127512.857990:0:16359:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789127512.857996:0:16359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789127512.858001:0:16359:0:(import.c:65:import_set_state_nolock()) ffff9345862ed800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789127512.858006:0:16359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789127512.858010:0:16359:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff934587ffb840 x1876035789568512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127524 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127512.858016:0:16359:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789127512.858019:0:16359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:0.0:1789127512.858084:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1876035789568512:0@lo:38:kworker.0 00000100:00080000:1.0:1789127512.859228:0:16359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789127512.859238:0:16359:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff934587ff83c0 x1876035789568640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127525 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127512.859295:0:16359:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9346904021c0 x1876035789569024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127528 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127512.859308:0:16359:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789127512.859313:0:16359:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1789127512.859332:0:16359:0:(import.c:65:import_set_state_nolock()) ffff934586070000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789127512.859449:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789569024:0@lo:400:kworker.0 00000100:00100000:0.0:1789127512.859948:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3649:1876035789569280:0@lo:39:umount.0 00000400:00000100:0.0:1789127512.859989:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035789569280 offset 0 length 224: 4 00010000:00010000:2.0:1789127512.864651:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127512.864666:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d597 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127512.864678:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fee00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127512.864682:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d597 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127512.864692:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d597 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127512.864699:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d597 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127512.864704:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789127512.864706:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789127512.864709:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789127512.864727:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9346b5488800 00010000:00010000:2.0:1789127512.864731:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd718aadfd785d597 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127512.864737:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785d590 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xd718aadfd785d597 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127512.864749:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127512.864751:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127512.864753:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127512.867063:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789568640:0@lo:400:kworker.0 00010000:00010000:2.0:1789127513.015741:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789127513.914792:0:8433:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789127513.914800:0:8433:0:(genops.c:885:class_export_put()) final put ffff934586eb8800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789127513.919545:0:9519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789127513.919553:0:9519:0:(genops.c:885:class_export_put()) final put ffff934587b5a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789127513.922044:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff934586eb8800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789127513.922117:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934586ebf000 for lustre-OST0000 00000020:00000080:2.0:1789127513.928388:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff934587b5a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1789127513.928452:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934587b5c000 for lustre-OST0001 00010000:00010000:2.0:1789127514.041590:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789127514.872137:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789127514.872146:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789127514.872149:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789127514.872152:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789127514.872301:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789569408:0@lo:400:kworker.0 00000400:00000100:3.0:1789127514.872353:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035789569408 offset 0 length 224: 4 00010000:00010000:2.0:1789127515.063713:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127516.087655:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127517.111670:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127518.008584:0:3649:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127508/real 1789127508] req@ffff934690402580 x1876035789568384/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789127518 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127518.008615:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff934690402580 x1876035789568384/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789127518 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789127518.008634:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346b5488800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127518.008659:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789127518.008663:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690402580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2eb81216-4f2e-430c-a0f6-5094c3b40588:3649:1876035789568384:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1789127518.008999:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789127518.009004:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789127518.009007:0:36:0:(import.c:65:import_set_state_nolock()) ffff9346b5488800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127518.009012:0:36:0:(import.c:510:import_select_connection()) MGC192.168.206.148@tcp: connect to NID 0@lo last attempt 469 00000100:00080000:2.0:1789127518.009017:0:36:0:(import.c:589:import_select_connection()) MGC192.168.206.148@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789127518.009024:0:36:0:(import.c:624:import_select_connection()) MGC192.168.206.148@tcp: import ffff9346b5488800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789127518.009054:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587895a40 x1876035789569536/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127518.009084:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789127518.009088:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789127518.009163:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127518.010194:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2eb81216-4f2e-430c-a0f6-5094c3b40588:3649:1876035789569536:0@lo:250:kworker.0 00000400:00000100:3.0:1789127518.010256:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876035789569536 offset 0 length 520: 4 00000100:00100000:1.0:1789127518.016686:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789569664:0@lo:400:kworker.0 00000400:00000100:1.0:1789127518.016760:0:3652:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035789569664 offset 0 length 224: 4 00010000:00010000:2.0:1789127518.135724:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127519.159652:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127520.185998:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127521.207657:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127522.104685:0:3649:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127512/real 1789127512] req@ffff934587ff8780 x1876035789569280/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789127522 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127522.104713:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff934587ff8780 x1876035789569280/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789127522 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789127522.104731:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934586070000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789127522.104751:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3649:1876035789569280:0@lo:39:umount.0 00000100:00080000:2.0:1789127522.105496:0:16359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789127522.105502:0:16359:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789127522.105531:0:16359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789127522.106430:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d5a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106444:0:16359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d5a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106464:0:16359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d5a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106470:0:16359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d5a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106491:0:16359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127522.106506:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127522.106535:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d5a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106541:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe400 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127522.106545:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d5a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106552:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d5a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127522.106559:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d5a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127522.106564:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789127522.106567:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:2.0:1789127522.106576:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9346b5488800 00010000:00010000:2.0:1789127522.106579:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd718aadfd785d5a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106585:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9346928fe400/0xd718aadfd785d59e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd718aadfd785d5a5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106606:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127522.106607:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127522.106609:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127522.106619:0:16359:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106626:0:16359:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d8c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106633:0:16359:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d8c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106638:0:16359:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d8c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106649:0:16359:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789127522.106652:0:16359:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1789127522.106656:0:16359:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1789127522.106677:0:16359:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1789127522.106681:0:16359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:2.0:1789127522.106687:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127522.106691:0:8454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d8c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106696:0:8454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d000 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127522.106699:0:8454:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d8c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106705:0:8454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d8c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127522.106716:0:8454:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d8c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127522.106721:0:8454:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789127522.106723:0:8454:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789127522.106724:0:8454:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789127522.106730:0:8454:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9346b5488800 00010000:00010000:2.0:1789127522.106733:0:8454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd718aadfd785d8c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106739:0:8454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93458858d000/0xd718aadfd785d8bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd718aadfd785d8c3 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127522.106747:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127522.106748:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127522.106750:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789127522.106757:0:16359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127522.106762:0:16359:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789127522.106766:0:16359:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9346aeecb490) has no exports 00000020:00080000:2.0:1789127522.106976:0:16359:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9346aeecb490) has no exports 00000020:01000000:2.0:1789127522.123974:0:16359:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff934587cc0180 - data ffff9346b16a8000/ffff934587e32800 00000020:01000000:2.0:1789127522.124130:0:16359:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9345863e9de0 - data ffff9346b16aed80/ffff9346b7359800 00100000:10000000:2.0:1789127522.145246:0:16359:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789127522.154700:0:16359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d2f0 00000020:00000080:3.0:1789127522.154712:0:16359:0:(genops.c:885:class_export_put()) final put ffff934586077800/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789127522.154727:0:16359:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9346b6688800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789127522.154731:0:16359:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9346b6688800 2 00000020:01000004:3.0:1789127522.154734:0:16359:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9346b6688800 from lustre-OST0000 00000020:00000080:3.0:1789127522.154768:0:16359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789127522.154777:0:16359:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789127522.154780:0:16359:0:(genops.c:885:class_export_put()) final put ffff9346aecbd800/lustre-OST0000_UUID 00000020:00000080:3.0:1789127522.154782:0:16359:0:(genops.c:844:class_export_destroy()) destroying export ffff9346aecbd800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789127522.154788:0:16359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789127522.154852:0:16359:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789127522.154857:0:16359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789127522.154860:0:16359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127522.154864:0:16359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789127522.154870:0:16359:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9345862ee800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127522.154875:0:16359:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9346aec61a48) has exports, disconnecting them 00000020:00080000:3.0:1789127522.154879:0:16359:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9345862ee800), last request at 1789127272 00000020:00000080:3.0:1789127522.154882:0:16359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d31a 00000020:00080000:3.0:1789127522.154900:0:16359:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9345862ee800): rc 0 00000020:00000080:3.0:1789127522.154905:0:16359:0:(genops.c:885:class_export_put()) final put ffff9345862ee800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789127522.155748:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff934586077800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789127522.155985:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9345862ee800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789127522.165497:0:16359:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789127522.165506:0:16359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789127522.165606:0:16359:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789127522.165613:0:16359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789127522.165899:0:16359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789127522.165907:0:16359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789127522.165914:0:16359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789127522.165918:0:16359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127522.165922:0:16359:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789127522.165929:0:16359:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9346aecba000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127522.165936:0:16359:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9346aeec8000) has exports, disconnecting them 00000020:00080000:3.0:1789127522.165940:0:16359:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9346aecba000), last request at 1789127272 00000020:00000080:3.0:1789127522.165944:0:16359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d32f 00000020:00080000:3.0:1789127522.165970:0:16359:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9346aecba000): rc 0 00000020:00000080:3.0:1789127522.165975:0:16359:0:(genops.c:885:class_export_put()) final put ffff9346aecba000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789127522.166227:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9345862ed800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789127522.166235:0:36:0:(genops.c:885:class_export_put()) final put ffff9346b7dd7800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789127522.166238:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b7dd7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789127522.166245:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789127522.169312:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346aecba000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1789127522.169468:0:16359:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1789127522.169473:0:16359:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789127522.169477:0:16359:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789127522.169482:0:16359:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789127522.170285:0:16359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127522.170294:0:16359:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1789127522.170300:0:16359:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9346b6688800 1 00000020:00000080:1.0:1789127522.170305:0:16359:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d2b8 00000020:00000080:1.0:1789127522.170313:0:16359:0:(genops.c:885:class_export_put()) final put ffff9346aecbd000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1789127522.170625:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934586070000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1789127522.170634:0:36:0:(genops.c:885:class_export_put()) final put ffff934586077000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1789127522.170637:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff934586077000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1789127522.170646:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000000:1.0:1789127522.170937:0:16359:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1789127522.170944:0:16359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789127522.170948:0:16359:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789127522.170952:0:16359:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9346aec60000) has no exports 00000020:00000080:0.0:1789127522.174410:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346aecbd000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789127522.214068:0:16359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127522.214082:0:16359:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789127522.214088:0:16359:0:(genops.c:885:class_export_put()) final put ffff9346b668b800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789127522.214093:0:16359:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b668b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789127522.214102:0:16359:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789127522.214219:0:16359:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9346b668c800 00000020:02000400:2.0:1789127522.214270:0:16359:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1789127522.235588:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789127523.130589:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789127523.130599:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127523.130602:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789127523.130605:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789127523.130942:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789569792:0@lo:400:kworker.0 00000400:00000100:2.0:1789127523.130995:0:3650:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035789569792 offset 0 length 224: 4 00010000:00010000:2.0:1789127523.263962:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127524.152599:0:3649:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127509/real 1789127509] req@ffff934587ff8000 x1876035789568768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789127524 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127524.152632:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff934587ff8000 x1876035789568768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789127524 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789127524.155239:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934587b5d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127524.155756:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789127524.155763:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1876035789568768:0@lo:38:kworker.0 00000100:00080000:1.0:1789127524.156272:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789127524.156277:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789127524.156280:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789127524.156283:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789127524.156286:0:36:0:(import.c:65:import_set_state_nolock()) ffff934587b5d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127524.156292:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 471 00000100:00080000:1.0:1789127524.156305:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789127524.156311:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff934587b5d800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789127524.156343:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ff9a40 x1876035789569920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127524.156412:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789570048:0@lo:400:kworker.0 00000400:00000100:1.0:1789127524.156459:0:3651:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035789570048 offset 0 length 224: 4 00000100:00100000:0.0:1789127524.156730:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1876035789569920:0@lo:38:kworker.0 00000400:00000100:0.0:1789127524.156755:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035789569920 offset 0 length 520: 4 00010000:00010000:2.0:1789127524.282844:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127525.304582:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1789127525.948106:0:3653:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127509/real 1789127509] req@ffff934587ff8b40 x1876035789568896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789127525 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127525.970141:0:3653:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff934587ff8b40 x1876035789568896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789127525 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789127525.970156:0:3653:0:(import.c:65:import_set_state_nolock()) ffff934587b44000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789127525.970160:0:3653:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000020:01000004:3.0:1789127525.972831:0:16561:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000100:00080000:1.0:1789127525.985755:0:3653:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1789127525.985906:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789127525.985913:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789127525.985917:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789127525.985920:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789127525.985923:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789127525.985925:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789127525.985929:0:36:0:(import.c:65:import_set_state_nolock()) ffff934587b44000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127525.985937:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 257 00000100:00080000:1.0:1789127525.985945:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff934587b44000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789127525.985979:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ffad00 x1876035789570176/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127525.986034:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3649:1876035789570176:0@lo:38:kworker.0 00000400:00000100:1.0:1789127525.986083:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876035789570176 offset 0 length 520: 4 00000100:00100000:1.0:1789127525.986151:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789568896:0@lo:400:kworker.0 00000020:01000004:3.0:1789127525.995737:0:16561:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789127525.995838:0:16561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d57b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127525.995853:0:16561:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d57b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127525.995860:0:16561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d57b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127525.995866:0:16561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d57b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127525.995890:0:16561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789127525.995895:0:16561:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789127525.995918:0:16561:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789127525.995928:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff934587ff9a40 x1876035789569920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127544 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127525.995947:0:16561:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789127525.995952:0:16561:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789127525.995957:0:16561:0:(import.c:65:import_set_state_nolock()) ffff934587b5d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789127525.995961:0:16561:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789127525.995965:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff934587ff9a40 x1876035789569920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127544 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127525.995971:0:16561:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789127525.995974:0:16561:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:2.0:1789127525.996064:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127525.996071:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d57b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.996078:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a0600 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127525.996081:0:6511:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d57b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.996090:0:6511:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d57b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127525.996096:0:6511:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d57b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127525.996101:0:6511:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789127525.996103:0:6511:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789127525.996105:0:6511:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789127525.996117:0:6511:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9346b5488800 00010000:00010000:2.0:1789127525.996121:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd718aadfd785d57b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.996136:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a0600/0xd718aadfd785d574 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd718aadfd785d57b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.996145:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127525.996146:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127525.996148:0:6511:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127525.996232:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1876035789569920:0@lo:38:kworker.0 00000100:00080000:3.0:1789127525.997367:0:16561:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789127525.997378:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff934690402940 x1876035789569152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127528 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127525.997455:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff934587ffa580 x1876035789569408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127530 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127525.997489:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9345878961c0 x1876035789569664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127534 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127525.997498:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9346b7396580 x1876035789569792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127539 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127525.997538:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff934587ffa940 x1876035789570048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127540 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127525.997546:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff934587ffad00 x1876035789570176/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127535 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127525.997557:0:16561:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789127525.997561:0:16561:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789127525.997566:0:16561:0:(import.c:65:import_set_state_nolock()) ffff934587b44000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789127525.997570:0:16561:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789127525.997574:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff934690402940 x1876035789569152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127528 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127525.997633:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878961c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789569664:0@lo:400:kworker.0 00000100:00100000:0.0:1789127525.997685:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789569792:0@lo:400:kworker.0 00000100:00100000:1.0:1789127525.997745:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690402940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789569152:0@lo:400:kworker.0 00000100:00100000:3.0:1789127525.997809:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff934587ffa580 x1876035789569408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127530 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127525.997818:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9345878961c0 x1876035789569664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127534 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127525.997825:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9346b7396580 x1876035789569792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127539 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127525.997833:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff934587ffa940 x1876035789570048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127540 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127525.997840:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff934587ffad00 x1876035789570176/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789127535 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127525.997845:0:16561:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789127525.997960:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3652:1876035789569408:0@lo:400:kworker.0 00000100:00100000:1.0:1789127525.998169:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789570048:0@lo:400:kworker.0 00000100:00100000:1.0:1789127525.998192:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3649:1876035789570176:0@lo:38:kworker.0 00000100:00100000:3.0:1789127525.998246:0:16561:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789127525.999670:0:16561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999685:0:16561:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999692:0:16561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999699:0:16561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999724:0:16561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127525.999731:0:16561:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785d8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999738:0:16561:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785d8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999760:0:16561:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999777:0:16561:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd718aadfd785d8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999802:0:16561:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789127525.999807:0:16561:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789127525.999832:0:16561:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789127525.999835:0:16561:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:2.0:1789127525.999846:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127525.999852:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999859:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93469a7a1600 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127525.999863:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999871:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127525.999877:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127525.999882:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789127525.999885:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789127525.999887:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789127525.999899:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9346b5488800 00010000:00010000:2.0:1789127525.999903:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd718aadfd785d589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999916:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93469a7a1600/0xd718aadfd785d582 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd718aadfd785d589 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999927:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127525.999930:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999936:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6a00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:2.0:1789127525.999939:0:6510:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd718aadfd785d8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999945:0:6510:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127525.999951:0:6510:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127525.999956:0:6510:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789127525.999958:0:6510:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789127525.999960:0:6510:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789127525.999976:0:6510:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9346b5488800 00010000:00010000:2.0:1789127525.999979:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd718aadfd785d8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999985:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9345886d6a00/0xd718aadfd785d8ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd718aadfd785d8b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127525.999997:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127525.999998:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127526.000005:0:6510:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789127526.000015:0:16561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127526.000020:0:16561:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789127526.000024:0:16561:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9346aec63490) has no exports 00000020:00080000:2.0:1789127526.000230:0:16561:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9346aec63490) has no exports 00010000:00010000:0.0:1789127526.002019:0:8454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789127526.005150:0:16561:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff934587cc0120 - data ffff9346b171ee58/ffff9346aec71400 00000020:01000000:2.0:1789127526.005319:0:16561:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9345860bf9c0 - data ffff9346b16b0288/ffff9346aec53c00 00100000:10000000:2.0:1789127526.025869:0:16561:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789127526.033321:0:16561:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d416 00000020:00000080:2.0:1789127526.033334:0:16561:0:(genops.c:885:class_export_put()) final put ffff9346b7dd3000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789127526.033357:0:16561:0:(tgt_mount.c:187:server_put_mount()) put mount ffff934586ebc000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789127526.033360:0:16561:0:(obd_mount.c:710:lustre_put_lsi()) put ffff934586ebc000 2 00000020:01000004:2.0:1789127526.033363:0:16561:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff934586ebc000 from lustre-OST0001 00000020:00000080:2.0:1789127526.033394:0:16561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127526.033403:0:16561:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789127526.033407:0:16561:0:(genops.c:885:class_export_put()) final put ffff9346b7dd7000/lustre-OST0001_UUID 00000020:00000080:2.0:1789127526.033410:0:16561:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b7dd7000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789127526.033417:0:16561:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789127526.033546:0:16561:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 2eb81216-4f2e-430c-a0f6-5094c3b40588->MGS 00010000:00010000:2.0:1789127526.033563:0:16561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934680031200/0xd718aadfd785d16f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d176 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127526.033576:0:16561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934680031200/0xd718aadfd785d16f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d176 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127526.033583:0:16561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789127526.033585:0:16561:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789127526.033588:0:16561:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789127526.033609:0:16561:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9346b5488800 00010000:00010000:2.0:1789127526.033613:0:16561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934680031200/0xd718aadfd785d16f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd718aadfd785d176 expref: -99 pid: 7452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127526.033642:0:16561:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785d5e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd718aadfd785d5eb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789127526.033649:0:16561:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785d5e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd718aadfd785d5eb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127526.033654:0:16561:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789127526.033656:0:16561:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789127526.033657:0:16561:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789127526.033668:0:16561:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9346b5488800 00010000:00010000:2.0:1789127526.033671:0:16561:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785d5e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd718aadfd785d5eb expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789127526.033686:0:16561:0:(import.c:65:import_set_state_nolock()) ffff9346b5488800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789127526.033690:0:16561:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789127526.033693:0:16561:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789127526.033694:0:16561:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789127526.033698:0:16561:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789127526.033708:0:16561:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff934587895a40 x1876035789569536/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789127533 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789127526.033729:0:16561:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789127526.033732:0:16561:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:3.0:1789127526.033927:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b7dd3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1789127526.034015:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:2eb81216-4f2e-430c-a0f6-5094c3b40588:3649:1876035789569536:0@lo:250:kworker.0 10000000:01000000:2.0:1789127526.034081:0:16561:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789127526.034089:0:16561:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d06c 00000020:00000080:2.0:1789127526.034095:0:16561:0:(genops.c:885:class_export_put()) final put ffff9346b548a800/2eb81216-4f2e-430c-a0f6-5094c3b40588 00000020:01000000:2.0:1789127526.034140:0:16561:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.148@tcp (flags='') 00000020:00000080:2.0:1789127526.034145:0:16561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127526.034150:0:16561:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.148@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789127526.034154:0:16561:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9346b18f3490) has no exports 10000000:01000000:1.0:1789127526.034208:0:6520:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789127526.034337:0:16561:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.206.148@tcp: client import never connected 00000100:00080000:2.0:1789127526.034350:0:16561:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789127526.034352:0:16561:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789127526.034354:0:16561:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789127526.034355:0:16561:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789127526.034503:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b548a800/2eb81216-4f2e-430c-a0f6-5094c3b40588 for MGC192.168.206.148@tcp 00000020:00000080:2.0:1789127526.034736:0:16561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127526.034742:0:16561:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.148@tcp (uuid 2eb81216-4f2e-430c-a0f6-5094c3b40588) 00000020:01000000:2.0:1789127526.034748:0:16561:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789127526.034752:0:16561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789127526.034755:0:16561:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789127526.034760:0:16561:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff934587b41000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789127526.034765:0:16561:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9346b64fb490) has exports, disconnecting them 00000020:00080000:2.0:1789127526.034770:0:16561:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff934587b41000), last request at 1789127296 00000020:00000080:2.0:1789127526.034775:0:16561:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d440 00000020:00080000:2.0:1789127526.034786:0:16561:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff934587b41000): rc 0 00000020:00000080:2.0:1789127526.034871:0:16561:0:(genops.c:885:class_export_put()) final put ffff934587b41000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789127526.034896:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9346b5488800 for MGC192.168.206.148@tcp 00000020:00000080:3.0:1789127526.034904:0:36:0:(genops.c:885:class_export_put()) final put ffff9346b5488000/2eb81216-4f2e-430c-a0f6-5094c3b40588 00000020:00000080:3.0:1789127526.034907:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b5488000/2eb81216-4f2e-430c-a0f6-5094c3b40588 for MGC192.168.206.148@tcp 00000020:01000000:3.0:1789127526.034912:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.148@tcp (2eb81216-4f2e-430c-a0f6-5094c3b40588) 00000020:00000080:3.0:1789127526.036418:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff934587b41000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1789127526.036587:0:16561:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1789127526.036591:0:16561:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789127526.036595:0:16561:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789127526.036600:0:16561:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789127526.036766:0:16561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789127526.036773:0:16561:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1789127526.036779:0:16561:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789127526.036783:0:16561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127526.036802:0:16561:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789127526.036809:0:16561:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff934587b42000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789127526.036814:0:16561:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9346bea51a48) has exports, disconnecting them 00000020:00080000:3.0:1789127526.036819:0:16561:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff934587b42000), last request at 1789127296 00000020:00000080:3.0:1789127526.036822:0:16561:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d455 00000020:00080000:3.0:1789127526.036836:0:16561:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff934587b42000): rc 0 00000020:00000080:3.0:1789127526.036841:0:16561:0:(genops.c:885:class_export_put()) final put ffff934587b42000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789127526.037433:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934587b5d800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789127526.037443:0:36:0:(genops.c:885:class_export_put()) final put ffff9346b5489000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789127526.037446:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9346b5489000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789127526.037458:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789127526.037547:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff934587b42000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1789127526.091609:0:16561:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789127526.091619:0:16561:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789127526.091623:0:16561:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789127526.091631:0:16561:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789127526.091741:0:6511:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789127526.091998:0:6510:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:1.0:1789127526.092083:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff934587b44000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1789127526.092581:0:8454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1789127526.093017:0:6506:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9346b1b8a200:6506] 1 exiting: rc = 0 00000100:00100000:2.0:1789127526.093074:0:10403:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_003: service thread [ffff934586f1cc00:10403] 3 exiting: rc = 0 00000100:00100000:1.0:1789127526.093177:0:9528:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9345862e1800:9528] 2 exiting: rc = 0 00000100:00100000:3.0:1789127526.096677:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9346835d8c00:6505] 0 exiting: rc = 1 00000100:00100000:2.0:1789127526.097009:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789127526.098270:0:9539:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff934587b53600:9539] 3 exiting: rc = 0 00000100:00100000:2.0:1789127526.098423:0:6507:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9346b1b01e00:6507] 0 exiting: rc = 1 00000100:00100000:3.0:1789127526.098670:0:6508:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9346b1b00200:6508] 1 exiting: rc = 0 00000100:00100000:0.0:1789127526.099118:0:6509:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9346b1b00400:6509] 2 exiting: rc = 0 00000100:00100000:2.0:1789127526.099415:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099424:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099431:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099437:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099444:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099450:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099465:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099471:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099477:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099483:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099488:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099494:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099499:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099504:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099536:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099550:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099556:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099562:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099567:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099574:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099580:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099585:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099591:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099596:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099601:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099607:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099612:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099617:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099622:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099627:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099633:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099638:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099643:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099648:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099653:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099658:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099664:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099669:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099674:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099679:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099684:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099697:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099702:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099718:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099724:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099728:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099733:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099739:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099745:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099750:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099756:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099761:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099766:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099772:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099777:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099781:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099786:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099906:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099911:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099916:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099921:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099926:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099931:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.099937:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789127526.101419:0:16561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789127526.101429:0:16561:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789127526.101435:0:16561:0:(genops.c:885:class_export_put()) final put ffff934587b40000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789127526.101439:0:16561:0:(genops.c:844:class_export_destroy()) destroying export ffff934587b40000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789127526.101455:0:16561:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789127526.101503:0:16561:0:(obd_mount.c:710:lustre_put_lsi()) put ffff934586ebc000 1 00000020:00000080:1.0:1789127526.102013:0:16561:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd718aadfd785d3e5 00000020:00000080:1.0:1789127526.102036:0:16561:0:(genops.c:885:class_export_put()) final put ffff934586219000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789127526.102082:0:16561:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789127526.102229:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff934586219000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789127526.102876:0:16561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789127526.102883:0:16561:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789127526.102887:0:16561:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9346aec64ed8) has no exports 00000020:00000080:2.0:1789127526.133477:0:16561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789127526.133490:0:16561:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1789127526.133497:0:16561:0:(genops.c:885:class_export_put()) final put ffff934586ebd800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1789127526.133501:0:16561:0:(genops.c:844:class_export_destroy()) destroying export ffff934586ebd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1789127526.134040:0:16561:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789127526.134669:0:16561:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff934586eb9000 00000020:01000000:3.0:1789127526.134713:0:16561:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789127526.134717:0:16561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789127526.134722:0:16561:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789127526.134726:0:16561:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9346aeecced8) has no exports 00000020:00000080:3.0:1789127526.134746:0:16561:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789127526.134752:0:16561:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789127526.134755:0:16561:0:(genops.c:885:class_export_put()) final put ffff9346aecbb000/OSS_uuid 00000020:00000080:3.0:1789127526.134758:0:16561:0:(genops.c:844:class_export_destroy()) destroying export ffff9346aecbb000/OSS_uuid for OSS 00000020:01000000:3.0:1789127526.134890:0:16561:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789127526.135005:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9346a9c54c00:8439] 1 exiting: rc = 0 00000100:00100000:1.0:1789127526.135010:0:8755:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9346b6627600:8755] 3 exiting: rc = 0 00000100:00100000:0.0:1789127526.135094:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9346b6418e00:8438] 0 exiting: rc = 1 00000100:00080000:2.0:1789127526.135131:0:6518:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789127526.135251:0:10363:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff9346bf908a00:10363] 4 exiting: rc = 0 00000100:00100000:1.0:1789127526.139208:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9346b1861200:8440] 2 exiting: rc = 0 00000100:00100000:3.0:1789127526.139365:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139374:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139386:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139394:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139400:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139405:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139410:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139416:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139421:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139433:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139438:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139445:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139450:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139455:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139460:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139465:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139470:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139474:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139478:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139483:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139487:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139492:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139497:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139505:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139548:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139553:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139559:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139564:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139569:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139575:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139580:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139585:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139589:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139594:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139599:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139604:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139609:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139615:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139620:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139626:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139631:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139636:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139640:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139646:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139651:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139663:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139668:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139675:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139680:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139685:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139689:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139697:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139702:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139706:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139712:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139717:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139723:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139729:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139734:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139747:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139752:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139758:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139879:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.139884:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.141669:0:11955:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff934587e7f200:11955] 2 exiting: rc = 0 00000100:00100000:0.0:1789127526.141925:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9346b721ec00:8442] 1 exiting: rc = 0 00000100:00100000:1.0:1789127526.142984:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9346bebff000:8441] 0 exiting: rc = 1 00000100:00100000:3.0:1789127526.143126:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143135:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143142:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143148:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143154:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143160:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143165:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143171:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143177:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143183:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143188:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143194:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143200:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143205:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143211:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143216:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143222:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143228:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143233:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143239:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143244:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143250:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143255:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143260:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143265:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143270:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143275:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143404:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143413:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143418:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143440:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143445:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143450:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143455:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143460:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143465:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143470:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143475:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143480:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143486:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143490:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143495:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143500:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143505:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143665:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143671:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143676:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143681:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143687:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143693:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143698:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143703:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143714:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143720:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143725:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143730:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143735:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143740:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143745:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143749:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143754:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.143759:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.144056:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.144068:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.146244:0:8445:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff93469028da00:8445] 2 exiting: rc = 0 00000100:00100000:0.0:1789127526.147042:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9346bea03600:8444] 1 exiting: rc = 0 00000100:00100000:0.0:1789127526.147468:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9346bea02a00:8443] 0 exiting: rc = 1 00000100:00100000:3.0:1789127526.147861:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147881:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147887:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147893:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147899:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147904:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147910:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147915:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147920:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147925:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147930:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147936:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147942:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147948:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147962:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147970:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147975:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147980:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147986:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147991:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.147997:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148003:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148008:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148013:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148019:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148025:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148031:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148036:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148042:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148048:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148054:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148060:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148065:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148071:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148076:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148081:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148095:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148100:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148121:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148128:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148133:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148139:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148144:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148149:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148155:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148160:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148166:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148171:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148176:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148182:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148187:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148192:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148197:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148203:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148221:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148228:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148234:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148240:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148245:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148250:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148256:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148261:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148266:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.148277:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789127526.153959:0:8446:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9346b7210800:8446] 0 exiting: rc = 1 00000100:00100000:3.0:1789127526.154092:0:8447:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9346bea27c00:8447] 1 exiting: rc = 0 00000100:00100000:2.0:1789127526.154257:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154266:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154272:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154304:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154309:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154314:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154319:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154401:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154409:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154414:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154419:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154423:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154428:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154432:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154437:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154442:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154446:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154452:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154458:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154463:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154468:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154473:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154478:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154483:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154489:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154493:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154498:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154503:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154544:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154551:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154556:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154561:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154566:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154571:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154576:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154581:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154587:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154592:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154606:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154617:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154624:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154629:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154634:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154639:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154644:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154650:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154655:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154659:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154664:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154669:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154674:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154678:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154684:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154689:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154694:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154699:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154704:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154709:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154721:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154727:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154732:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154737:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154743:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.154748:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789127526.156197:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9346b9daba00:8448] 0 exiting: rc = 1 00000100:00100000:1.0:1789127526.157470:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9346b706a000:8449] 1 exiting: rc = 0 00000100:00100000:2.0:1789127526.157663:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157678:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157686:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157691:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157696:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157702:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157708:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157715:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157721:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157738:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157758:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157776:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157781:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157786:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157917:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157923:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157929:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157935:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157942:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157948:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157953:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157959:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157980:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157987:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157993:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.157999:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158006:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158012:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158018:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158026:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158032:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158038:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158044:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158049:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158070:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158078:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158084:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158090:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158096:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158101:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158108:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158114:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158120:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158125:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158141:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158146:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158165:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158172:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158178:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158184:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158191:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158198:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158204:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158209:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158215:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158220:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158226:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158232:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158251:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158257:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158262:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158268:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158273:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789127526.158424:0:16561:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789127526.170484:0:16561:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789127544.587344:0:17325:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789127553.912539:0:17924:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789127553.912546:0:17924:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789127553.912548:0:17924:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789127553.913305:0:17924:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9346b7fe3800 00000020:01000004:3.0:1789127553.913333:0:17924:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789127553.913341:0:17924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789127553.913354:0:17924:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff934587f43490) 00000020:00000080:3.0:1789127553.913366:0:17924:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789127553.981799:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789127553.985261:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789127553.986459:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789127553.986907:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789127553.987115:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789127553.987394:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789127553.987614:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789127553.989861:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789127553.990306:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1789127553.990704:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1789127553.990925:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789127553.991429:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1789127553.992812:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789127553.993115:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1789127553.995745:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789127553.995995:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789127553.996254:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1789127553.996556:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1789127553.996840:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1789127553.997046:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789127553.997250:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1789127553.997601:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789127553.997888:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789127553.998286:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789127553.998583:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1789127553.999113:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1789127553.999365:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789127553.999678:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789127553.999939:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789127554.000166:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1789127554.000419:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1789127554.000656:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789127554.000863:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1789127554.001050:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789127554.001261:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789127554.001548:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789127554.001956:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1789127554.002218:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789127554.003818:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789127554.004134:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789127554.004391:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789127554.004613:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1789127554.005416:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789127554.005812:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1789127554.006229:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789127554.006875:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789127554.009729:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1789127554.011951:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1789127554.012533:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1789127554.012777:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1789127554.013670:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1789127554.013986:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1789127554.014242:0:17924:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1789127554.015065:0:17924:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789127554.015271:0:17924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789127554.015279:0:17924:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789127554.015290:0:17924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785e6c3 00000020:01000004:3.0:1789127554.015296:0:17924:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1789127554.015300:0:17924:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789127554.015306:0:17924:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9346b7fe3800 from MGS 00000020:01000004:3.0:1789127554.015390:0:17924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789127554.015402:0:17924:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff934587f40000) 00000020:00000080:3.0:1789127554.015412:0:17924:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789127554.015472:0:17924:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9346b7fe3800 from MGS, refs=2 00080000:01000000:3.0:1789127554.015477:0:17924:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789127554.015482:0:17924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785e6d1 00000100:00100000:3.0:1789127554.015696:0:17924:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789127554.015824:0:17924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789127554.015829:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789127554.020140:0:17924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789127554.020155:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789127554.020979:0:17924:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127554.021158:0:17924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789127554.021164:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1789127554.024125:0:17924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1789127554.024139:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1789127554.025041:0:17924:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789127554.025049:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789127554.025966:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127554.025970:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127554.025972:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127554.026212:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127554.026215:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127554.026217:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127554.026771:0:17924:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789127554.030464:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789127554.032419:0:17924:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789127554.037813:0:17936:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789127554.037881:0:17924:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789127554.037928:0:17924:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789127554.038712:0:17924:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789127554.039008:0:17924:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127554.039158:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789127554.039164:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1789127554.041531:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789127554.041543:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789127554.042158:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789127554.042165:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789127554.046152:0:17924:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789127554.046174:0:17924:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.148@tcp' 00000020:01000004:3.0:1789127554.046175:0:17924:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789127554.046204:0:17924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.148@tcp (typ=mgc) 00000020:00000080:3.0:1789127554.046215:0:17924:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.148@tcp (ffff934587f41a48) 00000020:00000080:3.0:1789127554.046229:0:17924:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789127554.046303:0:17924:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9346b6409800@MGC192.168.206.148@tcp: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1789127554.046458:0:17924:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.148@tcp-0 is initialized 00000040:01000000:3.0:1789127554.046464:0:17924:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789127554.049987:0:17941:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1789127554.054139:0:17942:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789127554.054186:0:17924:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.148@tcp (uuid cb5dd8f2-4233-4c77-b9d8-bfdb601a306e) 00000020:00000080:3.0:1789127554.054208:0:17924:0:(genops.c:1385:class_connect()) connect: client cb5dd8f2-4233-4c77-b9d8-bfdb601a306e, cookie 0xd718aadfd785e6df 00000100:00080000:3.0:1789127554.054220:0:17924:0:(import.c:510:import_select_connection()) MGC192.168.206.148@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127554.054226:0:17924:0:(import.c:624:import_select_connection()) MGC192.168.206.148@tcp: import ffff9346b6409800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789127554.054257:0:17924:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9346b7397480 x1876035789570304/t0(0) o250->MGC192.168.206.148@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127554.054278:0:17924:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cb5dd8f2-4233-4c77-b9d8-bfdb601a306e->MGS 00000020:01000004:3.0:1789127554.054295:0:17924:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789127554.054299:0:17924:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789127554.054323:0:17924:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff934587f44ed8) 00000020:00000080:3.0:1789127554.054336:0:17924:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789127554.060833:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3649:1876035789570304:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789127554.060905:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127554.066480:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789570304 00000100:00100000:0.0:1789127554.066493:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789570304 00000100:00100000:0.0:1789127554.066555:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127554.066564:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3649:x1876035789570304:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789127554.066594:0:17938:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from cb5dd8f2-4233-4c77-b9d8-bfdb601a306e@0@lo t0 exp 0000000000000000 cur 515 last 0 00000020:00000080:0.0:1789127554.066629:0:17938:0:(genops.c:1385:class_connect()) connect: client cb5dd8f2-4233-4c77-b9d8-bfdb601a306e, cookie 0xd718aadfd785e6ed 00000100:00080000:0.0:1789127554.066768:0:17938:0:(import.c:65:import_set_state_nolock()) ffff9346c1ef2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127554.066847:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+5:3649:x1876035789570304:12345-0@lo:250:mount.lustre.0 Request processed in 283us (5941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127554.066855:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127554.067031:0:3649:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.206.148@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789127554.067046:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.206.148@tcp: connect to target with instance 0 00000100:00080000:1.0:1789127554.067053:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.206.148@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789127554.067058:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789127554.067061:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346b6409800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789127554.067064:0:3649:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789127554.067076:0:3649:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789127554.067081:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3649:1876035789570304:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1789127554.070006:0:17924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127554.070184:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789127554.070190:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789127554.072743:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789127554.072754:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789127554.073271:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789127554.073278:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1789127554.075985:0:17924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127554.076151:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1789127554.076156:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789127554.077326:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789127554.077334:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789127554.120753:0:17924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127554.120946:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789127554.120953:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789127554.122084:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789127554.122094:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789127554.122680:0:17924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789127554.122852:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789127554.122857:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789127554.123423:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789127554.123432:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789127554.124083:0:17924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127554.124235:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789127554.124240:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789127554.125122:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789127554.125130:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789127554.125998:0:17924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127554.126145:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789127554.126149:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789127554.129097:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789127554.129112:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789127554.153924:0:17924:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127554.154130:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789127554.154138:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789127554.157934:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789127554.157948:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789127554.159494:0:17924:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789127554.159768:0:17924:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789127554.161097:0:17924:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789127554.161130:0:17924:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789127554.161138:0:17924:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789127554.161255:0:17924:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789127554.161288:0:17924:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.148@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789127554.161296:0:17924:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789127554.161298:0:17924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789127554.161299:0:17924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127554.161300:0:17924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127554.161302:0:17924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127554.161303:0:17924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127554.161304:0:17924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127554.161305:0:17924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789127554.161376:0:17924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127554.161378:0:17924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789127554.161381:0:17924:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789127554.161383:0:17924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789127554.161384:0:17924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789127554.161386:0:17924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127554.161387:0:17924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127554.161388:0:17924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127554.161389:0:17924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127554.161390:0:17924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127554.161391:0:17924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789127554.161392:0:17924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127554.161393:0:17924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789127554.161417:0:17924:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789127554.161437:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789570432:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789127554.161501:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.161617:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127554.161744:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789570432 00000100:00100000:0.0:1789127554.161751:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789570432 00000100:00100000:0.0:1789127554.161832:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127554.161842:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+5:17924:x1876035789570432:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789127554.161892:0:17940:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789127554.161895:0:17940:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789127554.161899:0:17940:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789127554.162154:0:17961:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789127554.162614:0:17940:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1789127554.164185:0:17962:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789127554.164191:0:17962:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1789127554.164194:0:17962:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789127554.164197:0:17962:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789127554.164433:0:17962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1789127554.164808:0:17940:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789127554.164819:0:17940:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789127554.166129:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+5:17924:x1876035789570432:12345-0@lo:253:mount.lustre.0 Request processed in 4284us (4623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127554.166145:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127554.166223:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789570432:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789127554.166237:0:17924:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789127554.166240:0:17924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789127554.166242:0:17924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789127554.166244:0:17924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127554.166245:0:17924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127554.166246:0:17924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127554.166248:0:17924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127554.166249:0:17924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127554.166250:0:17924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789127554.166252:0:17924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127554.166253:0:17924:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789127554.166270:0:17924:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9346b7fe3800 from lustre-MDT0000 10000000:01000000:0.0:1789127554.166305:0:17924:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789127554.166308:0:17924:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789127554.166376:0:17924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff934587f41a48 10000000:01000000:0.0:1789127554.166381:0:17924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789127554.166388:0:17924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff934587f41a48 from 1 10000000:01000000:0.0:1789127554.166391:0:17924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789127554.166425:0:17924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127554.166436:0:17924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127554.166445:0:17924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127554.166463:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690401e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789570560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127554.166494:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127554.166806:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1b18cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127554.166919:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789570560 00000100:00100000:2.0:1789127554.166925:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789570560 00000100:00100000:2.0:1789127554.166993:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127554.167000:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+5:17924:x1876035789570560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127554.167012:0:17939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127554.167025:0:17939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9345886d6a00/0xd718aadfd785e6fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e6f4 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127554.167045:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d6a00/0xd718aadfd785e6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e6f4 expref: 6 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127554.167055:0:17939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9345886d6a00/0xd718aadfd785e6fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e6f4 expref: 6 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127554.167070:0:17939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6a00, rc 0) 00000100:00100000:2.0:1789127554.167109:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+6:17924:x1876035789570560:12345-0@lo:101:mount.lustre.0 Request processed in 109us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127554.167115:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127554.167172:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690401e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789570560:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127554.167185:0:17924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e6fb expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.167203:0:17924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e6fb expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127554.167260:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789570688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127554.167283:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.167410:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127554.167470:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789570688 00000100:00100000:3.0:1789127554.167474:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789570688 00000100:00100000:3.0:1789127554.167494:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127554.167500:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+6:17924:x1876035789570688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127554.167590:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+6:17924:x1876035789570688:12345-0@lo:501:mount.lustre.0 Request processed in 90us (305us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789127554.167596:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789127554.167673:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789570688:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789127554.167700:0:17924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789127554.167720:0:17924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e6fb expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.167728:0:17924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e6fb expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127554.167736:0:17924:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9346b7fe3800 10000000:01000000:1.0:1789127554.167740:0:17924:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789127554.167743:0:17924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9346b7fe3800 10000000:01000000:1.0:1789127554.167745:0:17924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789127554.167747:0:17924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9346b7fe3800 from 1 10000000:01000000:1.0:1789127554.167750:0:17924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789127554.167765:0:17924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858c400/0xd718aadfd785e702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.167772:0:17924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93458858c400/0xd718aadfd785e702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.167780:0:17924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93458858c400/0xd718aadfd785e702 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127554.167797:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789570816:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789127554.167819:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.167835:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127554.167893:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789570816 00000100:00100000:3.0:1789127554.167897:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789570816 00000100:00100000:3.0:1789127554.167913:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127554.167918:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+6:17924:x1876035789570816:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127554.167924:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127554.167934:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501a600/0xd718aadfd785e709 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e702 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.167947:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501a600/0xd718aadfd785e709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e702 expref: 7 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.167955:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501a600/0xd718aadfd785e709 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e702 expref: 7 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.167962:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501a600, rc 0) 00000100:00100000:3.0:1789127554.167993:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+7:17924:x1876035789570816:12345-0@lo:101:mount.lustre.0 Request processed in 75us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127554.167999:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789127554.168124:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789570816:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127554.168134:0:17924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93458858c400/0xd718aadfd785e702 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e709 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.168141:0:17924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93458858c400/0xd718aadfd785e702 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e709 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127554.168151:0:17924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789127554.168164:0:17924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858c400/0xd718aadfd785e702 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e709 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.168171:0:17924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93458858c400/0xd718aadfd785e702 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e709 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127554.168176:0:17924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789127554.168180:0:17924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789127554.168183:0:17924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9346b7fe3800 10000000:01000000:1.0:1789127554.168186:0:17924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789127554.168188:0:17924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789127554.168190:0:17924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789127554.168202:0:17924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858de00/0xd718aadfd785e710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.168209:0:17924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93458858de00/0xd718aadfd785e710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.168221:0:17924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93458858de00/0xd718aadfd785e710 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127554.168232:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789570944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789127554.168253:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.168263:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127554.168323:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789570944 00000100:00100000:3.0:1789127554.168326:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789570944 00000100:00100000:3.0:1789127554.168346:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127554.168351:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+7:17924:x1876035789570944:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127554.168357:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127554.168364:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501ba00/0xd718aadfd785e717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e710 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.168376:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501ba00/0xd718aadfd785e717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e710 expref: 8 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.168384:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501ba00/0xd718aadfd785e717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e710 expref: 8 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.168390:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501ba00, rc 0) 00000100:00100000:3.0:1789127554.168421:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+8:17924:x1876035789570944:12345-0@lo:101:mount.lustre.0 Request processed in 69us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127554.168426:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127554.168546:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789570944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127554.168555:0:17924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93458858de00/0xd718aadfd785e710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e717 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.168563:0:17924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93458858de00/0xd718aadfd785e710 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e717 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127554.168599:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789571072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127554.168621:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.168659:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127554.168747:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789571072 00000100:00100000:3.0:1789127554.168751:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789571072 00000100:00100000:3.0:1789127554.168768:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127554.168773:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+8:17924:x1876035789571072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127554.168876:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+9:17924:x1876035789571072:12345-0@lo:501:mount.lustre.0 Request processed in 102us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127554.168883:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127554.168945:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789571072:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127554.168968:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789571200:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127554.169001:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.169020:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517a900 going to sleep for 11 seconds 00000100:00100000:3.0:1789127554.169064:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789571200 00000100:00100000:3.0:1789127554.169068:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789571200 00000100:00100000:3.0:1789127554.169083:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127554.169088:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+9:17924:x1876035789571200:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127554.169815:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+9:17924:x1876035789571200:12345-0@lo:503:mount.lustre.0 Request processed in 725us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127554.169828:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789127554.169905:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789571200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127554.170199:0:17963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17963:1876035789571328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127554.170229:0:17963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127554.170247:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789571328 00000100:00100000:3.0:1789127554.170250:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789571328 00000100:00100000:3.0:1789127554.170270:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127554.170275:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+9:17963:x1876035789571328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127554.170818:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+9:17963:x1876035789571328:12345-0@lo:502:llog_process_th.0 Request processed in 541us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127554.170826:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127554.170864:0:17963:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b7341000 going to sleep for 11 seconds 00000100:00100000:3.0:1789127554.170879:0:17963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17963:1876035789571328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789127554.170900:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127554.170910:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127554.170912:0:17963:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789127554.170917:0:17963:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789127554.170920:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127554.170934:0:17963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9346b1b11a48) 00000020:00000080:3.0:1789127554.170950:0:17963:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789127554.170955:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789127554.171021:0:17963:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789127554.171028:0:17963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785e725 00000020:00000080:3.0:1789127554.171227:0:17963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789127554.171233:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127554.171236:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127554.171238:0:17963:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789127554.171241:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127554.171250:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127554.171252:0:17963:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789127554.171256:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127554.171263:0:17963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9346b1b10000) 00000020:00000080:3.0:1789127554.171273:0:17963:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789127554.171276:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789127554.171279:0:17963:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789127554.171282:0:17963:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789127554.171287:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789127554.171911:0:17963:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9346b7fe3800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789127554.171927:0:17963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff934587dd8000) 00000020:00000080:2.0:1789127554.171937:0:17963:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789127554.171989:0:17963:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789127554.171994:0:17963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd718aadfd785e73a 00000020:00000080:2.0:1789127554.172098:0:17963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789127554.172103:0:17963:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789127554.172107:0:17963:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd718aadfd785e741 00080000:01000000:2.0:1789127554.172112:0:17963:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789127554.172116:0:17963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785e748 00010000:00010000:2.0:1789127554.254848:0:17963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789127554.255382:0:17963:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:2.0:1789127554.255790:0:17963:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789127554.256346:0:17963:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff934587dd9a48) 00000020:00000080:2.0:1789127554.256364:0:17963:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789127554.256443:0:17963:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789127554.256450:0:17963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785e756 00000020:00000080:3.0:1789127554.257096:0:17963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789127554.260300:0:17963:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd718aadfd785e75d 00000020:00000080:2.0:1789127554.263857:0:17963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789127554.263871:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127554.263877:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127554.263879:0:17963:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789127554.263882:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789127554.263884:0:17963:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1789127554.263886:0:17963:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789127554.263887:0:17963:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789127554.263888:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789127554.263897:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127554.263899:0:17963:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789127554.263902:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127554.263907:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127554.263908:0:17963:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789127554.263912:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789127554.263963:0:17963:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789127554.263979:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127554.263983:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127554.263984:0:17963:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789127554.263987:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127554.263990:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127554.263992:0:17963:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1789127554.263994:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789127554.264000:0:17963:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:00000080:2.0:1789127554.264028:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789127554.264044:0:17963:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff934587ddced8) 00000020:00000080:2.0:1789127554.264059:0:17963:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789127554.264065:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789127554.264134:0:17963:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1789127554.264139:0:17963:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789127554.264146:0:17963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785e76b 00010000:00080000:2.0:1789127554.264177:0:17963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff934588d57800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:2.0:1789127554.265849:0:17963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1789127554.268433:0:17963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789127554.268447:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1789127554.268480:0:17963:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789127554.268498:0:17963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd718aadfd785e772 00000100:00080000:2.0:1789127554.268585:0:17963:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127554.268592:0:17963:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff934588d57800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789127554.268623:0:17963:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587895680 x1876035789571456/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127554.268765:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789571456:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789127554.268828:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789127554.268884:0:17963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1789127554.268930:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127554.268933:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127554.268935:0:17963:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1789127554.268938:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789127554.268941:0:17963:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:2.0:1789127554.268943:0:17963:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789127554.268945:0:17963:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789127554.268946:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789127554.268949:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127554.268950:0:17963:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789127554.268953:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789127554.268957:0:17963:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1789127554.268960:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127554.268962:0:17963:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789127554.268964:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789127554.268967:0:17963:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:2.0:1789127554.268986:0:17963:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789127554.268989:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789127554.269001:0:17963:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff934587ddb490) 00000020:00000080:2.0:1789127554.269013:0:17963:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789127554.269018:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789127554.269081:0:17963:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789127554.269087:0:17963:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789127554.269093:0:17963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785e780 00010000:00080000:2.0:1789127554.269119:0:17963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff934587f1c000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:2.0:1789127554.269336:0:17963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789127554.270119:0:17963:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789127554.270362:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789571456 00000100:00100000:0.0:1789127554.270371:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789571456 00000100:00100000:0.0:1789127554.270413:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789127554.270420:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7396d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1876035789571456:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1789127554.270437:0:17950:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:2.0:1789127554.273462:0:17963:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789127554.278975:0:17963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127554.282592:0:17963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789127554.286063:0:17963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789127554.286484:0:17969:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789127554.286490:0:17969:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789127554.287178:0:17963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789127554.287189:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789127554.287235:0:17963:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789127554.287254:0:17963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd718aadfd785e787 00000100:00080000:3.0:1789127554.287263:0:17963:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127554.287269:0:17963:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff934587f1c000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789127554.287303:0:17963:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9346b7395680 x1876035789571584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127554.287448:0:17963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789127554.287574:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127554.287578:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127554.287580:0:17963:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789127554.287583:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789127554.287586:0:17963:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1789127554.287588:0:17963:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127554.287589:0:17963:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127554.287591:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789127554.287593:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127554.287600:0:17963:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789127554.287605:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789127554.287609:0:17963:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789127554.287613:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127554.287614:0:17963:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789127554.287617:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789127554.287620:0:17963:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:3.0:1789127554.287659:0:17963:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789127554.287662:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127554.287672:0:17963:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9346b1b14ed8) 00000020:00000080:3.0:1789127554.287684:0:17963:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1789127554.287688:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789127554.287746:0:17963:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789127554.287751:0:17963:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789127554.287756:0:17963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd718aadfd785e795 00010000:00080000:3.0:1789127554.287784:0:17963:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9346bea9b000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1789127554.287977:0:17963:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789127554.288038:0:17963:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789127554.288052:0:17963:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:1.0:1789127554.288738:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7395680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789571584:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789127554.288796:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035789571584 offset 0 length 520: 4 00000040:00080000:1.0:1789127554.292832:0:17963:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127554.293409:0:17963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789127554.293590:0:17963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1789127554.293954:0:17971:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789127554.293958:0:17971:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:0.0:1789127554.299228:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7396d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1876035789571456:12345-0@lo:38:llog_process_th.0 Request processed in 28801us (30394us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789127554.299243:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:00000080:3.0:1789127554.299421:0:17963:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000100:00080000:2.0:1789127554.299884:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934588d57800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127554.299891:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127554.299895:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789571456:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1789127554.299920:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789127554.299970:0:17963:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789127554.299989:0:17963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd718aadfd785e79c 00000100:00080000:2.0:1789127554.299997:0:17963:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127554.300001:0:17963:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9346bea9b000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789127554.300032:0:17963:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587895680 x1876035789571712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127554.300059:0:17963:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:1.0:1789127554.300210:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789571712:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1789127554.300250:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035789571712 offset 0 length 520: 4 00000020:01000000:2.0:1789127554.300426:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127554.300431:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127554.300432:0:17963:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789127554.300435:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127554.300439:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127554.300440:0:17963:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789127554.300443:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789127554.300445:0:17963:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789127554.300447:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127554.300449:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127554.300451:0:17963:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789127554.300453:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127554.300455:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127554.300456:0:17963:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789127554.300460:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789127554.300488:0:17963:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587897840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17963:1876035789571840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127554.300892:0:17963:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127554.300977:0:17963:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b54de780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127554.301029:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789571840 00000100:00100000:3.0:1789127554.301035:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789571840 00000100:00100000:3.0:1789127554.301114:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127554.301124:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+9:17963:x1876035789571840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789127554.301249:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+9:17963:x1876035789571840:12345-0@lo:502:llog_process_th.0 Request processed in 126us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127554.301257:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127554.301340:0:17963:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587897840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17963:1876035789571840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789127554.301372:0:17963:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127554.301378:0:17963:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127554.301380:0:17963:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789127554.301383:0:17963:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789127554.301596:0:17924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1789127554.301620:0:17924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789127554.301655:0:17924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858de00/0xd718aadfd785e710 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e717 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127554.301678:0:17924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93458858de00/0xd718aadfd785e710 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e717 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127554.301685:0:17924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9346b7fe3800 from 1 10000000:01000000:0.0:1789127554.301687:0:17924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127554.301712:0:17924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127554.301719:0:17924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127554.301728:0:17924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127554.301742:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789571968:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127554.301775:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127554.302060:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1b18cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127554.302133:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789571968 00000100:00100000:2.0:1789127554.302138:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789571968 00000100:00100000:2.0:1789127554.302163:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127554.302170:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+9:17924:x1876035789571968:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127554.302180:0:17939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127554.302193:0:17939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9345886d7000/0xd718aadfd785e7aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e7a3 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127554.302213:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d7000/0xd718aadfd785e7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e7a3 expref: 10 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127554.302222:0:17939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9345886d7000/0xd718aadfd785e7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e7a3 expref: 10 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127554.302231:0:17939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7000, rc 0) 00000100:00100000:2.0:1789127554.302271:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+10:17924:x1876035789571968:12345-0@lo:101:mount.lustre.0 Request processed in 101us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127554.302279:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127554.302443:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789571968:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127554.302456:0:17924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e7aa expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127554.302464:0:17924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e7aa expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127554.303109:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789572096:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789127554.303151:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127554.303185:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1b18cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127554.303260:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789572096 00000100:00100000:2.0:1789127554.303265:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789572096 00000100:00100000:2.0:1789127554.303301:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127554.303412:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+10:17924:x1876035789572096:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789127554.303429:0:17939:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789127554.303435:0:17939:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789127554.303535:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+10:17924:x1876035789572096:12345-0@lo:256:mount.lustre.0 Request processed in 198us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127554.303543:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789127554.303723:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789572096:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789127554.304275:0:17924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789127554.304410:0:17924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e7aa expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127554.304421:0:17924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e7aa expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127554.304430:0:17924:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b7fe3800 from 1 10000000:01000000:0.0:1789127554.304432:0:17924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127554.304460:0:17924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127554.304467:0:17924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127554.304476:0:17924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127554.304491:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789572224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127554.304565:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127554.304591:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1b18cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127554.304679:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789572224 00000100:00100000:1.0:1789127554.304685:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789572224 00000100:00100000:1.0:1789127554.304723:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789127554.304731:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+10:17924:x1876035789572224:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127554.304741:0:17940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127554.304755:0:17940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93458858d000/0xd718aadfd785e7b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e7b1 expref: -99 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.304773:0:17940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93458858d000/0xd718aadfd785e7b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e7b1 expref: 11 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.304783:0:17940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93458858d000/0xd718aadfd785e7b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e7b1 expref: 11 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.304791:0:17940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858d000, rc 0) 00000100:00100000:1.0:1789127554.304831:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+11:17924:x1876035789572224:12345-0@lo:101:mount.lustre.0 Request processed in 101us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127554.304850:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127554.305009:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789572224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127554.305023:0:17924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e7b8 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127554.305032:0:17924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e7b8 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127554.305098:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789572352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127554.305123:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127554.305150:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1b18cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127554.305210:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789572352 00000100:00100000:2.0:1789127554.305215:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789572352 00000100:00100000:2.0:1789127554.305240:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127554.305247:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+11:17924:x1876035789572352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127554.305455:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+11:17924:x1876035789572352:12345-0@lo:501:mount.lustre.0 Request processed in 207us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127554.305462:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789127554.305542:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789572352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127554.305568:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789572480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127554.305604:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127554.305630:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1b18cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127554.305931:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789572480 00000100:00100000:1.0:1789127554.305937:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789572480 00000100:00100000:1.0:1789127554.305962:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789127554.305969:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+11:17924:x1876035789572480:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127554.306047:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+11:17924:x1876035789572480:12345-0@lo:503:mount.lustre.0 Request processed in 78us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127554.306055:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789127554.306137:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789572480:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127554.306601:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17973:1876035789572608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127554.306717:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127554.306735:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1b18cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127554.306792:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789572608 00000100:00100000:1.0:1789127554.306796:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789572608 00000100:00100000:1.0:1789127554.306831:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789127554.306839:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+11:17973:x1876035789572608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127554.307241:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+11:17973:x1876035789572608:12345-0@lo:502:llog_process_th.0 Request processed in 402us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127554.307249:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127554.307403:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690403480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17973:1876035789572608:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127554.307428:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127554.307438:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127554.307440:0:17973:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789127554.307446:0:17973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9346b7fe3800 00000020:00000080:0.0:1789127554.307448:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127554.307455:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127554.307457:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127554.307458:0:17973:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789127554.307460:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127554.307462:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127554.307464:0:17973:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789127554.307466:0:17973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9346b7fe3800 00000020:00000080:0.0:1789127554.307468:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127554.307595:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127554.307599:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127554.307600:0:17973:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789127554.307603:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127554.307606:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127554.307607:0:17973:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789127554.307610:0:17973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b7fe3800 00000020:00000080:0.0:1789127554.307613:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789127554.308446:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127554.309464:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127554.309469:0:17973:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127554.309475:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127554.309481:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127554.309482:0:17973:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127554.309488:0:17973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b7fe3800 00000020:00000080:1.0:1789127554.309491:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127554.309553:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127554.309556:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127554.309558:0:17973:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127554.309560:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127554.309563:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127554.309570:0:17973:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789127554.309574:0:17973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b7fe3800 00000020:00000080:1.0:1789127554.309577:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127554.309596:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127554.309598:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127554.309600:0:17973:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789127554.309602:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127554.309605:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127554.309606:0:17973:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789127554.309609:0:17973:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b7fe3800 00000020:00000080:1.0:1789127554.309611:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789127554.309744:0:17973:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17973:1876035789572736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127554.309813:0:17973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.309911:0:17973:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789127554.313749:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789572736 00000100:00100000:3.0:1789127554.313769:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789572736 00000100:00100000:0.0:1789127554.329295:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127554.329386:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+11:17973:x1876035789572736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127554.329568:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+11:17973:x1876035789572736:12345-0@lo:502:llog_process_th.0 Request processed in 262us (19755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127554.329577:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127554.330397:0:17973:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17973:1876035789572736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789127554.330437:0:17973:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127554.330445:0:17973:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127554.330447:0:17973:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789127554.330451:0:17973:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:1.0:1789127554.331614:0:17924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:1.0:1789127554.331726:0:17924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789127554.331746:0:17924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e7b8 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.331758:0:17924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e7b8 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127554.331814:0:17924:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789127554.331817:0:17924:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9346b7fe3800 10000000:01000000:1.0:1789127554.331819:0:17924:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9346b7fe3800 10000000:01000000:1.0:1789127554.331823:0:17924:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789127554.331829:0:17924:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9346b7fe3800 from 1 10000000:01000000:1.0:1789127554.331832:0:17924:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789127554.331865:0:17924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858cc00/0xd718aadfd785e7bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.331884:0:17924:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93458858cc00/0xd718aadfd785e7bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.331894:0:17924:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93458858cc00/0xd718aadfd785e7bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127554.331916:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789572864:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789127554.331974:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.332013:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127554.332770:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789572864 00000100:00100000:0.0:1789127554.332779:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789572864 00000100:00100000:0.0:1789127554.332823:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789127554.332832:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+11:17924:x1876035789572864:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127554.332845:0:17940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127554.332861:0:17940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fece00/0xd718aadfd785e7c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e7bf expref: -99 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127554.332885:0:17940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fece00/0xd718aadfd785e7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e7bf expref: 12 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127554.332907:0:17940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fece00/0xd718aadfd785e7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e7bf expref: 12 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127554.332915:0:17940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fece00, rc 0) 00000100:00100000:0.0:1789127554.332966:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17924:x1876035789572864:12345-0@lo:101:mount.lustre.0 Request processed in 135us (991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127554.332973:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789127554.333505:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789572864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127554.334441:0:17924:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93458858cc00/0xd718aadfd785e7bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e7c6 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.334453:0:17924:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93458858cc00/0xd718aadfd785e7bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e7c6 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127554.335095:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789572992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127554.335150:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.335183:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127554.337306:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789572992 00000100:00100000:0.0:1789127554.337331:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789572992 00000100:00100000:0.0:1789127554.337388:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127554.337398:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17924:x1876035789572992:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127554.337564:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17924:x1876035789572992:12345-0@lo:501:mount.lustre.0 Request processed in 167us (2413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127554.337571:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789127554.338058:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789572992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127554.338110:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789573120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127554.338155:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.338192:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127554.338242:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789573120 00000100:00100000:0.0:1789127554.338248:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789573120 00000100:00100000:0.0:1789127554.338790:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127554.338801:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17924:x1876035789573120:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127554.338902:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17924:x1876035789573120:12345-0@lo:503:mount.lustre.0 Request processed in 103us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127554.338910:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789127554.340908:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789573120:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127554.342484:0:17979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878943c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17979:1876035789573248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789127554.342597:0:17979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127554.342629:0:17979:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b54de300 going to sleep for 11 seconds 00000100:00100000:1.0:1789127554.344344:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789573248 00000100:00100000:1.0:1789127554.344361:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789573248 00000100:00100000:1.0:1789127554.344410:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789127554.344420:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17979:x1876035789573248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127554.344647:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17979:x1876035789573248:12345-0@lo:502:llog_process_th.0 Request processed in 217us (2039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127554.344655:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789127554.344713:0:17979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878943c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17979:1876035789573248:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1789127554.344773:0:17979:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1789127554.344788:0:17979:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9346b64fb490) 00000020:00000080:1.0:1789127554.344806:0:17979:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1789127554.344888:0:17979:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9346b7fe3800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789127554.344893:0:17979:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9346b7fe3800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789127554.344896:0:17979:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9346b7fe3800 4 00010000:00080000:1.0:1789127554.344926:0:17979:0:(ldlm_lib.c:102:import_set_conn()) imp ffff934587e17800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.148@tcp at head 00010000:00010000:1.0:1789127554.353475:0:17979:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1789127554.354494:0:17979:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1789127554.354563:0:17979:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789127554.354573:0:17979:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd718aadfd785e7d4 00000100:00080000:1.0:1789127554.354582:0:17979:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789127554.354588:0:17979:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff934587e17800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789127554.354618:0:17979:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ff8f00 x1876035789573376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127554.355477:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876035789573376:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789127554.355553:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.357920:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789573376 00000100:00100000:1.0:1789127554.357931:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789573376 00000100:00100000:1.0:1789127554.357971:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127554.357978:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1876035789573376:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789127554.364461:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690403480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1876035789573376:12345-0@lo:38:llog_process_th.0 Request processed in 6473us (8898us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789127554.364485:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1789127554.365070:0:17979:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789127554.369813:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789127554.369827:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934587e17800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789127554.369846:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789127554.369850:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876035789573376:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789127554.370812:0:17979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17979:1876035789573504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127554.370885:0:17979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.370920:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789573504 00000100:00100000:1.0:1789127554.370926:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789573504 00000100:00100000:1.0:1789127554.370964:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789127554.370974:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17979:x1876035789573504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127554.371078:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17979:x1876035789573504:12345-0@lo:502:llog_process_th.0 Request processed in 105us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127554.371086:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789127554.371131:0:17979:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127554.371147:0:17979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17979:1876035789573504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127554.371184:0:17979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17979:1876035789573632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789127554.371215:0:17979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.371228:0:17979:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127554.371745:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789573632 00000100:00100000:0.0:1789127554.371751:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789573632 00000100:00100000:0.0:1789127554.371784:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789127554.371792:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17979:x1876035789573632:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789127554.371875:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17979:x1876035789573632:12345-0@lo:502:llog_process_th.0 Request processed in 84us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127554.371883:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789127554.372822:0:17979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17979:1876035789573632:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789127554.372856:0:17979:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789127554.372925:0:17924:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789127554.372950:0:17924:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789127554.372977:0:17924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858cc00/0xd718aadfd785e7bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e7c6 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.372988:0:17924:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93458858cc00/0xd718aadfd785e7bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e7c6 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789127554.373046:0:17924:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789127554.373048:0:17924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789127554.373050:0:17924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127554.373051:0:17924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127554.373052:0:17924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127554.373054:0:17924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127554.373055:0:17924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127554.373057:0:17924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789127554.373058:0:17924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127554.373060:0:17924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789127554.373063:0:17924:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1789127554.373066:0:17924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789127554.373068:0:17924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789127554.373069:0:17924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127554.373070:0:17924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127554.373071:0:17924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127554.373073:0:17924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127554.373074:0:17924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127554.373075:0:17924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789127554.373076:0:17924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127554.373077:0:17924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789127554.373093:0:17924:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789127554.373107:0:17924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789573760:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789127554.373150:0:17924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.373186:0:17924:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127554.373422:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789573760 00000100:00100000:0.0:1789127554.373428:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789573760 00000100:00100000:0.0:1789127554.373471:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789127554.373479:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17924:x1876035789573760:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789127554.373501:0:17939:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789127554.373535:0:17939:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789127554.378578:0:17939:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789127554.378592:0:17939:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1789127554.378869:0:17961:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789127554.378873:0:17961:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789127554.378895:0:17961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.378910:0:17961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9345886d7000/0xd718aadfd785e7aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e7a3 expref: 12 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.378932:0:17961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.378970:0:17961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9345886d7000/0xd718aadfd785e7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785e7a3 expref: 12 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.378985:0:17961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9345886d7000/0xd718aadfd785e7aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785e7a3 expref: 12 pid: 17939 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127554.379000:0:17961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17961:1876035789573888:0@lo:104: 00000100:00100000:1.0:1789127554.379060:0:17961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127554.379105:0:17961:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789127554.379161:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17924:x1876035789573760:12345-0@lo:253:mount.lustre.0 Request processed in 5682us (6010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127554.379171:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789127554.379234:0:17924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17924:1876035789573760:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789127554.379244:0:17924:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789127554.379247:0:17924:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789127554.379249:0:17924:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789127554.379251:0:17924:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127554.379252:0:17924:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127554.379253:0:17924:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127554.379254:0:17924:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127554.379255:0:17924:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789127554.379257:0:17924:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789127554.379259:0:17924:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127554.379260:0:17924:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789127554.379272:0:17924:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1789127554.379739:0:17928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789573888 00000100:00100000:3.0:1789127554.379745:0:17928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789573888 00000100:00100000:3.0:1789127554.379781:0:17928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127554.379789:0:17928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+3:17961:x1876035789573888:12345-0@lo:104: 00010000:00010000:3.0:1789127554.379802:0:17928:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e7aa expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.379852:0:17928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789127554.379858:0:17928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+3:17961:x1876035789573888:12345-0@lo:104: Request processed in 71us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127554.379865:0:17928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1789127554.391382:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127554.391393:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e7aa expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.391416:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fede00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127554.391421:0:17934:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785e7aa expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.391431:0:17934:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785e7aa expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127554.391439:0:17934:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785e7aa expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127554.391445:0:17934:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789127554.391486:0:17934:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e7aa expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.391492:0:17934:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127554.391533:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e7aa expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.391541:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934587fede00/0xd718aadfd785e7a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e7aa expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.391554:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127554.391556:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127554.391558:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127554.391596:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3652:1876035789574016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127554.391826:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127554.392427:0:17930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789574016 00000100:00100000:3.0:1789127554.392434:0:17930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789574016 00010000:00010000:3.0:1789127554.392459:0:17930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9345886d7000/0xd718aadfd785e7aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e7a3 expref: 12 pid: 17939 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127554.392488:0:17930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127554.392496:0:17930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:3652:x1876035789574016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127554.392524:0:17930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127554.392529:0:17930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9345886d7000/0xd718aadfd785e7aa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e7a3 expref: 12 pid: 17939 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.392541:0:17930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9345886d7000/0xd718aadfd785e7aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785e7a3 expref: 12 pid: 17939 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.392560:0:17930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.392568:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789127554.392588:0:17930:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013714757s 00010000:00010000:3.0:1789127554.392592:0:17930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.392599:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.392606:0:17930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.392612:0:17930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.392618:0:17930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c800 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127554.392622:0:17930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.392629:0:17930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.392654:0:17930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127554.392663:0:17930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127554.392701:0:17930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffa580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:3652:x1876035789574016:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127554.392708:0:17930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127554.398732:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3652:1876035789574016:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127554.398778:0:17961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9345886d7000/0xd718aadfd785e7aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785e7a3 expref: 11 pid: 17939 timeout: 615 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127554.398798:0:17961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17961:1876035789573888:0@lo:104: 00010000:00010000:1.0:1789127554.398818:0:17961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.398828:0:17961:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.398833:0:17961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127554.398838:0:17961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93458858c800/0xd718aadfd785e7db lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1789127554.423915:0:17924:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1789127554.424304:0:17924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789127554.425212:0:17989:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789127554.425405:0:17924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:0.0:1789127554.425791:0:17990:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9346904030c0 x1876035789574144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127554.425803:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00000040:01000000:1.0:1789127554.426197:0:17924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789127554.426234:0:17924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1789127554.426409:0:17988:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1789127554.426432:0:17988:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:0.0:1789127554.426611:0:17989:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127554.428786:0:17989:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789127554.428864:0:17989:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00000080:1.0:1789127554.429188:0:17924:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789127554.429203:0:17924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789127554.429284:0:17924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127554.430318:0:17924:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789127554.430911:0:17924:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789127554.430946:0:17924:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1789127554.432417:0:17924:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:1.0:1789127554.434102:0:17924:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789127554.435884:0:17924:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789127554.435920:0:17924:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb4b241917988 00100000:10000000:1.0:1789127554.435928:0:17924:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789127554.436971:0:17924:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789127554.436988:0:17924:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789127554.437006:0:17924:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789127554.437022:0:17924:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789127554.437817:0:17924:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789127554.438027:0:17924:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789127555.065928:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789127555.319715:0:17942:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789127555.319722:0:17942:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9346b7fe3800 from 7 10000000:01000000:1.0:1789127555.319726:0:17942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789127555.319767:0:17942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127555.319778:0:17942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127555.319788:0:17942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127555.319813:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789574272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789127555.319875:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127555.319921:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aed09f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127555.320233:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789574272 00000100:00100000:2.0:1789127555.320240:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789574272 00000100:00100000:2.0:1789127555.320295:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789127555.320304:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+11:17942:x1876035789574272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127555.320317:0:17940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127555.320331:0:17940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e7e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e7e2 expref: -99 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127555.320353:0:17940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e7e2 expref: 12 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127555.320363:0:17940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e7e2 expref: 12 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127555.320372:0:17940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7c00, rc 0) 00000100:00100000:2.0:1789127555.320745:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17942:x1876035789574272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 440us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127555.320754:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127555.320909:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789574272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127555.320926:0:17942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e7e9 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127555.320936:0:17942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e7e9 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127555.320992:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789574400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789127555.321024:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127555.321055:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586f41cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127555.321097:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789574400 00000100:00100000:1.0:1789127555.321102:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789574400 00000100:00100000:1.0:1789127555.321135:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789127555.321143:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17942:x1876035789574400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789127555.321157:0:17939:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789127555.321171:0:17939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789127555.321175:0:17939:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789127555.321247:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:17942:x1876035789574400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127555.321255:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789127555.321326:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789574400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789127555.321363:0:17942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789127555.321370:0:17942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e7e9 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127555.321379:0:17942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e7e9 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127555.384728:0:17978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789127555.448568:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00010000:00010000:1.0:1789127556.088037:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127556.409327:0:17978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789127556.473551:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00010000:00010000:0.0:1789127557.118806:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127557.495568:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00010000:00010000:2.0:1789127558.135877:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127558.520197:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00000001:02000400:0.0:1789127558.814802:0:18233:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789127559.160672:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789127559.482155:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789127559.482162:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789127559.482165:0:37:0:(import.c:65:import_set_state_nolock()) ffff934588d57800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127559.482173:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:1.0:1789127559.482178:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789127559.482185:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff934588d57800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789127559.482198:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789574528:0@lo:400:kworker.0 00000100:00100000:1.0:1789127559.482267:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127559.482337:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789574528 00000100:00100000:1.0:1789127559.482344:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789574528 00000100:00100000:1.0:1789127559.482382:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789127559.482390:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:3653:x1876035789574528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127559.482435:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:3653:x1876035789574528:12345-0@lo:400:kworker.0 Request processed in 45us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127559.482442:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789127559.482484:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789574528:0@lo:400:kworker.0 00000100:00100000:1.0:1789127559.482542:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ffbc00 x1876035789574656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127559.482559:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127559.482563:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789127559.482566:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127559.482569:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789127559.482583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789127559.482586:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789127559.482588:0:37:0:(import.c:65:import_set_state_nolock()) ffff934587e17800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127559.482593:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff934587e17800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789127559.482661:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789574656:0@lo:38:kworker.0 00000100:00100000:1.0:1789127559.482708:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127559.482750:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789574656 00000100:00100000:1.0:1789127559.482754:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789574656 00000100:00100000:1.0:1789127559.482775:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127559.482779:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1876035789574656:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1789127559.482794:0:17951:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789127559.485602:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934690401a40 x1876035789574784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127559.493181:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1876035789574656:12345-0@lo:38:kworker.0 Request processed in 10392us (10465us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789127559.493195:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127559.493244:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690401a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876035789574784:0@lo:38:kworker.0 00000100:00100000:1.0:1789127559.499371:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789127559.499423:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934588d57800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127559.499428:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789127559.499432:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789574656:0@lo:38:kworker.0 00000100:00100000:3.0:1789127559.499792:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789574784 00000100:00100000:3.0:1789127559.499799:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789574784 00000100:00100000:3.0:1789127559.499833:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127559.499841:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1876035789574784:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1789127559.499866:0:17947:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:3.0:1789127559.499896:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd718aadfd785e7f0 00000004:00100000:3.0:1789127559.499910:0:17947:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789127559.500026:0:17947:0:(import.c:65:import_set_state_nolock()) ffff934587fd3800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127559.500092:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3649:x1876035789574784:12345-0@lo:38:kworker.0 Request processed in 249us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127559.500107:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789127559.500300:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff934690401a40 x1876035789574784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789127559.500320:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789127559.500327:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789127559.500332:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789127559.500334:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934587e17800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789127559.500340:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690401a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3649:1876035789574784:0@lo:38:kworker.0 00000100:00100000:1.0:1789127559.544725:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00000020:00000004:3.0:1789127559.700246:0:18285:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127559.700494:0:18285:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789127560.190593:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127560.568229:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00000020:00000004:1.0:1789127560.719068:0:18335:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789127560.719264:0:18335:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789127561.210441:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127561.591632:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00010000:00010000:0.0:1789127562.231795:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127562.617646:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00010000:00010000:2.0:1789127563.255713:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127563.650713:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00010000:00010000:2.0:1789127564.280772:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127564.599779:0:3649:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127554/real 1789127554] req@ffff934587895680 x1876035789571712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127564 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127564.599812:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff934587895680 x1876035789571712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127564 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127564.599824:0:3649:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127554/real 1789127554] req@ffff9346b7395680 x1876035789571584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127564 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127564.599836:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9346b7395680 x1876035789571584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127564 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789127564.599853:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346bea9b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127564.599873:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789127564.599877:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789571712:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789127564.599883:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934587f1c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127564.599888:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789127564.599891:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7395680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789571584:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789127564.600220:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789127564.600225:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789127564.600228:0:37:0:(import.c:65:import_set_state_nolock()) ffff934588d57800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127564.600232:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1789127564.600238:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789127564.600244:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff934588d57800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789127564.600279:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934690401680 x1876035789575040/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127564.600296:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127564.600300:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789127564.600302:0:37:0:(import.c:65:import_set_state_nolock()) ffff934587f1c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127564.600305:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:0.0:1789127564.600307:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789127564.600311:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff934587f1c000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789127564.600334:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934690403840 x1876035789575168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127564.600344:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127564.600360:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789127564.600362:0:37:0:(import.c:65:import_set_state_nolock()) ffff9346bea9b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127564.600366:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 515 00000100:00080000:0.0:1789127564.600368:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789127564.600372:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9346bea9b000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789127564.600385:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934690400b40 x1876035789575296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789127564.600417:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690401680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789575040:0@lo:38:kworker.0 00000100:00100000:0.0:1789127564.600474:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127564.600540:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690403840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789575168:0@lo:8:kworker.0 00000400:00000100:0.0:1789127564.600562:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035789575168 offset 0 length 520: 4 00000100:00100000:0.0:1789127564.600579:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789575296:0@lo:8:kworker.0 00000400:00000100:0.0:1789127564.600612:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035789575296 offset 0 length 520: 4 00000100:00100000:0.0:1789127564.600639:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789575040 00000100:00100000:0.0:1789127564.600645:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789575040 00000100:00100000:0.0:1789127564.600674:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127564.600682:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1876035789575040:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789127564.600697:0:17950:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789127564.602551:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789574912:0@lo:400:kworker.0 00000100:00100000:1.0:1789127564.602621:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127564.602722:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127564.602743:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690402940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789575424:0@lo:400:kworker.0 00000100:00100000:1.0:1789127564.602771:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127564.605647:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789575424 00000100:00100000:3.0:1789127564.605661:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789575424 00000100:00100000:3.0:1789127564.605706:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127564.605716:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789575424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127564.605800:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789575424:12345-0@lo:400:kworker.0 Request processed in 85us (3027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127564.605808:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789127564.605875:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff934690402940 x1876035789575424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127580 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127564.605889:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690402940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789575424:0@lo:400:kworker.0 00000100:00100000:2.0:1789127564.608456:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789574912 00000100:00100000:2.0:1789127564.608469:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789574912 00000100:00100000:2.0:1789127564.608590:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789127564.608601:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:3650:x1876035789574912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127564.608693:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:3650:x1876035789574912:12345-0@lo:400:kworker.0 Request processed in 94us (6071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127564.608701:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789127564.608792:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789574912:0@lo:400:kworker.0 00000100:00100000:1.0:1789127564.631254:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3649:x1876035789575040:12345-0@lo:38:kworker.0 Request processed in 30563us (30771us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789127564.631268:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789127564.631363:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934588d57800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789127564.631369:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789127564.631373:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690401680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789575040:0@lo:38:kworker.0 00000100:00100000:0.0:1789127564.663627:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00010000:00010000:2.0:1789127565.304018:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127565.687795:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00010000:00010000:2.0:1789127566.327733:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789127566.492377:0:18680:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789127566.492381:0:18680:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789127566.492382:0:18680:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789127566.492491:0:18680:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9346c1efc000 00000020:01000004:0.0:1789127566.492541:0:18680:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789127566.492553:0:18680:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789127566.492568:0:18680:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9346aed19a48) 00000020:00000080:0.0:1789127566.492595:0:18680:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789127566.577213:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789127566.580525:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789127566.582131:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789127566.582704:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789127566.582940:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789127566.583179:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1789127566.583418:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1789127566.583786:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789127566.583992:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789127566.584411:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789127566.584930:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789127566.585203:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789127566.585447:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789127566.585821:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789127566.594806:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789127566.595889:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789127566.596178:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1789127566.596421:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789127566.596741:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789127566.596976:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1789127566.597209:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1789127566.601092:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789127566.601733:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789127566.602021:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1789127566.602259:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1789127566.602499:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789127566.602786:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1789127566.603034:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1789127566.603264:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1789127566.603500:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789127566.603786:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789127566.603993:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789127566.604678:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789127566.604898:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789127566.605197:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789127566.605553:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789127566.607656:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789127566.609131:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789127566.609403:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789127566.609735:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789127566.609936:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1789127566.610132:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789127566.610407:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1789127566.610963:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789127566.611341:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1789127566.611658:0:18680:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00080000:01000000:3.0:1789127566.613958:0:18680:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789127566.614173:0:18680:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789127566.614183:0:18680:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789127566.614195:0:18680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd718aadfd785e7fe 00000020:01000004:3.0:1789127566.614201:0:18680:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789127566.614219:0:18680:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789127566.614222:0:18680:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789127566.614228:0:18680:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789127566.614252:0:18680:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789127566.614256:0:18680:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789127566.625766:0:18680:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789127566.625820:0:18680:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.148@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1789127566.625825:0:18680:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789127566.625827:0:18680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789127566.625829:0:18680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127566.625830:0:18680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127566.625831:0:18680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127566.625833:0:18680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127566.625835:0:18680:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127566.625836:0:18680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127566.625837:0:18680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789127566.625841:0:18680:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1789127566.625843:0:18680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789127566.625844:0:18680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789127566.625846:0:18680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127566.625847:0:18680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127566.625848:0:18680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127566.625849:0:18680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127566.625850:0:18680:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127566.625851:0:18680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127566.625852:0:18680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789127566.625878:0:18680:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789127566.625904:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789575552:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789127566.625971:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127566.626015:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687e36180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127566.627709:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789575552 00000100:00100000:1.0:1789127566.627720:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789575552 00000100:00100000:1.0:1789127566.627788:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789127566.627799:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:18680:x1876035789575552:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789127566.627849:0:17939:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789127566.627852:0:17939:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1789127566.627859:0:17939:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789127566.628192:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:18680:x1876035789575552:12345-0@lo:253:mount.lustre.0 Request processed in 394us (2219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127566.628201:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789127566.629050:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789575552:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789127566.629064:0:18680:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789127566.629068:0:18680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789127566.629069:0:18680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789127566.629071:0:18680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127566.629072:0:18680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127566.629073:0:18680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127566.629074:0:18680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127566.629075:0:18680:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789127566.629078:0:18680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127566.629079:0:18680:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789127566.629100:0:18680:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9346c1efc000 from lustre-MDT0001 10000000:01000000:3.0:1789127566.629130:0:18680:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1789127566.629133:0:18680:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789127566.629139:0:18680:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff934587f41a48 local copy 00010000:00010000:3.0:1789127566.629150:0:18680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e6fb expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127566.629240:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789575680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127566.629282:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127566.629867:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687e36000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127566.634736:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789575680 00000100:00100000:2.0:1789127566.634749:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789575680 00000100:00100000:2.0:1789127566.634867:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789127566.634877:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:18680:x1876035789575680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127566.635013:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:18680:x1876035789575680:12345-0@lo:501:mount.lustre.0 Request processed in 135us (5727us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127566.635020:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127566.635095:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789575680:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789127566.635118:0:18680:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789127566.635144:0:18680:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789127566.635153:0:18680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e6fb expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.635180:0:18680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e6fb expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127566.635212:0:18680:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9346c1efc000 10000000:01000000:3.0:1789127566.635216:0:18680:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789127566.635221:0:18680:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff934587f41a48 10000000:01000000:3.0:1789127566.635224:0:18680:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789127566.635227:0:18680:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff934587f41a48 from 1 10000000:01000000:3.0:1789127566.635229:0:18680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789127566.635259:0:18680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501ae00/0xd718aadfd785e805 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.635267:0:18680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93468501ae00/0xd718aadfd785e805 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.635276:0:18680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93468501ae00/0xd718aadfd785e805 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127566.635294:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789575808:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789127566.635326:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127566.640126:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687e36000 going to sleep for 11 seconds 00000100:00100000:1.0:1789127566.640231:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789575808 00000100:00100000:1.0:1789127566.640240:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789575808 00000100:00100000:1.0:1789127566.640284:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789127566.640293:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+12:18680:x1876035789575808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127566.640307:0:17939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127566.640325:0:17939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93458858c200/0xd718aadfd785e80c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e805 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127566.640350:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93458858c200/0xd718aadfd785e80c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e805 expref: 13 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127566.640360:0:17939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93458858c200/0xd718aadfd785e80c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e805 expref: 13 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127566.640380:0:17939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c200, rc 0) 00000100:00100000:1.0:1789127566.640477:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+13:18680:x1876035789575808:12345-0@lo:101:mount.lustre.0 Request processed in 184us (5149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127566.640484:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127566.643038:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789575808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127566.643067:0:18680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93468501ae00/0xd718aadfd785e805 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e80c expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.643080:0:18680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93468501ae00/0xd718aadfd785e805 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e80c expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127566.643122:0:18680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789127566.643143:0:18680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501ae00/0xd718aadfd785e805 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e80c expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.643151:0:18680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93468501ae00/0xd718aadfd785e805 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e80c expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127566.643161:0:18680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9346c1efc000 10000000:01000000:3.0:1789127566.643185:0:18680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789127566.643191:0:18680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9346c1efc000 from 1 10000000:01000000:3.0:1789127566.643193:0:18680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789127566.643223:0:18680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785e813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.643232:0:18680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785e813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.643240:0:18680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785e813 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127566.643258:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789575936:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789127566.643310:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127566.643353:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687e36000 going to sleep for 11 seconds 00000100:00100000:2.0:1789127566.643412:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789575936 00000100:00100000:2.0:1789127566.643419:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789575936 00000100:00100000:2.0:1789127566.643466:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127566.643475:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+13:18680:x1876035789575936:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127566.643486:0:17939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127566.643497:0:17939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9345886d6200/0xd718aadfd785e81a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e813 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127566.643551:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d6200/0xd718aadfd785e81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e813 expref: 14 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127566.643560:0:17939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9345886d6200/0xd718aadfd785e81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e813 expref: 14 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127566.643584:0:17939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6200, rc 0) 00000100:00100000:2.0:1789127566.643622:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+14:18680:x1876035789575936:12345-0@lo:101:mount.lustre.0 Request processed in 148us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127566.643629:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127566.644023:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789575936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127566.644036:0:18680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785e813 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e81a expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.644044:0:18680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785e813 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e81a expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127566.644064:0:18680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789127566.644068:0:18680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785e813 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e81a expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.644074:0:18680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93468501bc00/0xd718aadfd785e813 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e81a expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127566.644079:0:18680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789127566.644083:0:18680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789127566.644088:0:18680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9346c1efc000 10000000:01000000:3.0:1789127566.644091:0:18680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789127566.644094:0:18680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789127566.644096:0:18680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789127566.644111:0:18680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501be00/0xd718aadfd785e821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.644118:0:18680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93468501be00/0xd718aadfd785e821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.644125:0:18680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93468501be00/0xd718aadfd785e821 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127566.644138:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789576064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789127566.644165:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127566.644182:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687e36000 going to sleep for 11 seconds 00000100:00100000:0.0:1789127566.644233:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789576064 00000100:00100000:0.0:1789127566.644238:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789576064 00000100:00100000:0.0:1789127566.644275:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789127566.644283:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+14:18680:x1876035789576064:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127566.644290:0:17940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127566.644299:0:17940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fed600/0xd718aadfd785e828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e821 expref: -99 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.644313:0:17940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fed600/0xd718aadfd785e828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e821 expref: 15 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.644321:0:17940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fed600/0xd718aadfd785e828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e821 expref: 15 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.644327:0:17940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fed600, rc 0) 00000100:00100000:0.0:1789127566.644364:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+15:18680:x1876035789576064:12345-0@lo:101:mount.lustre.0 Request processed in 82us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127566.644369:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127566.644560:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789576064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127566.644677:0:18680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93468501be00/0xd718aadfd785e821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e828 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.644696:0:18680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93468501be00/0xd718aadfd785e821 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e828 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127566.646244:0:18680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1789127566.646815:0:18680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127566.649975:0:17978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789127566.651141:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789127566.651193:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789127566.651210:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789127566.651227:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789127566.651241:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1789127566.651254:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1789127566.651267:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1789127566.651279:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789127566.651295:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789127566.651308:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1789127566.651322:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1789127566.651336:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1789127566.651349:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1789127566.651360:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789127566.651373:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789127566.651385:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1789127566.651399:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789127566.651412:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789127566.651424:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1789127566.651438:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789127566.651452:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789127566.651464:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789127566.651478:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789127566.651505:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1789127566.651539:0:18680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1789127566.651647:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789576192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127566.651719:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127566.651767:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687e360c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127566.651906:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789576192 00000100:00100000:2.0:1789127566.651914:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789576192 00000100:00100000:2.0:1789127566.651964:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789127566.651973:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+15:18680:x1876035789576192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127566.652104:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+15:18680:x1876035789576192:12345-0@lo:501:mount.lustre.0 Request processed in 132us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127566.652112:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789127566.652353:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789576192:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127566.652385:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789576320:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127566.652423:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127566.652444:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687e360c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127566.652681:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789576320 00000100:00100000:2.0:1789127566.652686:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789576320 00000100:00100000:2.0:1789127566.652720:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789127566.652728:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+15:18680:x1876035789576320:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127566.653369:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+15:18680:x1876035789576320:12345-0@lo:503:mount.lustre.0 Request processed in 639us (943us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127566.653378:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789127566.657023:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789576320:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789127566.657455:0:18680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789127566.657696:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789576448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127566.657763:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.657866:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698db5900 going to sleep for 11 seconds 00000100:00100000:2.0:1789127566.661908:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789576448 00000100:00100000:2.0:1789127566.661938:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789576448 00000100:00100000:2.0:1789127566.662183:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789127566.662195:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+15:18680:x1876035789576448:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127566.663157:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+15:18680:x1876035789576448:12345-0@lo:502:mount.lustre.0 Request processed in 962us (5392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127566.663166:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789127566.663259:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789576448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127566.663491:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789127566.663555:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1789127566.663585:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1789127566.663603:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1789127566.663634:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1789127566.663650:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1789127566.663666:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1789127566.663684:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1789127566.663699:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1789127566.663711:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1789127566.663724:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1789127566.663737:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1789127566.663751:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1789127566.663765:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1789127566.663778:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1789127566.663791:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1789127566.663805:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1789127566.663816:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1789127566.663835:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1789127566.663849:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1789127566.663862:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1789127566.663876:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1789127566.663889:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1789127566.663905:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1789127566.663921:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1789127566.663934:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1789127566.663947:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1789127566.663958:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1789127566.663971:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1789127566.663983:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1789127566.663995:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1789127566.664008:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1789127566.664032:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1789127566.664048:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1789127566.664061:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1789127566.664074:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1789127566.664086:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1789127566.664100:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1789127566.664112:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1789127566.664123:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1789127566.664135:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1789127566.664148:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1789127566.664162:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1789127566.664175:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1789127566.664209:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789576576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127566.664257:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.664299:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aed096c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127566.669106:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789576576 00000100:00100000:3.0:1789127566.669120:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789576576 00000100:00100000:3.0:1789127566.669192:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789127566.669204:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+15:18680:x1876035789576576:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127566.669371:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+15:18680:x1876035789576576:12345-0@lo:502:mount.lustre.0 Request processed in 171us (5113us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127566.669379:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127566.669784:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789576576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127566.669858:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1789127566.669870:0:18680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:0.0:1789127566.674111:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127566.674126:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127566.674128:0:18684:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789127566.674136:0:18684:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1789127566.674140:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127566.674155:0:18684:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9346aed1ced8) 00000020:00000080:0.0:1789127566.674175:0:18684:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:0.0:1789127566.674180:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789127566.674264:0:18684:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789127566.674272:0:18684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd718aadfd785e836 00000020:00000080:0.0:1789127566.674483:0:18684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1789127566.674488:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127566.674491:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127566.674498:0:18684:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1789127566.674501:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127566.674504:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127566.674506:0:18684:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1789127566.674659:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127566.674667:0:18684:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9346aed1b490) 00000020:00000080:0.0:1789127566.674679:0:18684:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:0.0:1789127566.674683:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789127566.674685:0:18684:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1789127566.674688:0:18684:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1789127566.674693:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789127566.674743:0:18684:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9346c1efc000 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1789127566.674754:0:18684:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9346aed18000) 00000020:00000080:0.0:1789127566.674763:0:18684:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:0.0:1789127566.674823:0:18684:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789127566.674828:0:18684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd718aadfd785e84b 00000020:00000080:0.0:1789127566.674923:0:18684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1789127566.674930:0:18684:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789127566.674935:0:18684:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xd718aadfd785e852 00080000:01000000:0.0:1789127566.674940:0:18684:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789127566.674943:0:18684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd718aadfd785e859 00000100:00100000:0.0:1789127566.719883:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00010000:00010000:3.0:1789127566.771772:0:18684:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1789127566.772770:0:18684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:3.0:1789127566.773090:0:18684:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789127566.775710:0:18684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1789127566.775722:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127566.775729:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127566.775731:0:18684:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1789127566.775735:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127566.775741:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127566.775743:0:18684:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1789127566.775745:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789127566.775750:0:18684:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:00000080:3.0:1789127566.775776:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127566.775792:0:18684:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9346b1b13490) 00000020:00000080:3.0:1789127566.775813:0:18684:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1789127566.775825:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789127566.775906:0:18684:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1789127566.775914:0:18684:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789127566.775924:0:18684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd718aadfd785e867 00010000:00080000:3.0:1789127566.775955:0:18684:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9346b71ec800@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1789127566.777495:0:18684:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1789127566.785839:0:18684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789127566.785854:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789127566.785894:0:18684:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789127566.785915:0:18684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd718aadfd785e86e 00000100:00080000:0.0:1789127566.785926:0:18684:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127566.785933:0:18684:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9346b71ec800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789127566.785968:0:18684:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9346904021c0 x1876035789576704/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127566.785999:0:18684:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1789127566.786049:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127566.786061:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127566.786063:0:18684:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1789127566.786067:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789127566.786069:0:18684:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1789127566.786071:0:18684:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789127566.786072:0:18684:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789127566.786073:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789127566.786076:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127566.786078:0:18684:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789127566.786080:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127566.786085:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127566.786086:0:18684:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1789127566.786089:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789127566.786125:0:18684:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789127566.786138:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127566.786142:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127566.786143:0:18684:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1789127566.786146:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789127566.786147:0:18684:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:0.0:1789127566.786149:0:18684:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789127566.786150:0:18684:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789127566.786152:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789127566.786154:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127566.786155:0:18684:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789127566.786158:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789127566.786161:0:18684:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789127566.786167:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127566.786168:0:18684:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789127566.786171:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789127566.786174:0:18684:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:0.0:1789127566.786197:0:18684:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789127566.786199:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789127566.786211:0:18684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9346b18f3490) 00000020:00000080:0.0:1789127566.786223:0:18684:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1789127566.786233:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789127566.786296:0:18684:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789127566.786303:0:18684:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789127566.786308:0:18684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd718aadfd785e87c 00010000:00080000:0.0:1789127566.786335:0:18684:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9346c1ef3800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.148@tcp at head 00010000:00010000:0.0:1789127566.786553:0:18684:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1789127566.786693:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789576704:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789127566.786771:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127566.786839:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789576704 00000100:00100000:3.0:1789127566.786846:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789576704 00000100:00100000:3.0:1789127566.786875:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127566.786882:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7395e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1876035789576704:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789127566.786903:0:17951:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 527 last 0 00000020:00000080:3.0:1789127566.786930:0:17951:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd718aadfd785e883 00000004:00100000:3.0:1789127566.786944:0:17951:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1789127566.786950:0:17951:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789127566.787538:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789127566.787545:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789127566.787548:0:37:0:(import.c:65:import_set_state_nolock()) ffff934588d57800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127566.787553:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 525 00000100:00080000:1.0:1789127566.787558:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789127566.787563:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff934588d57800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789127566.787662:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ff8780 x1876035789576832/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127566.787686:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127566.787689:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789127566.787692:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127566.787695:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789127566.787730:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789576960:0@lo:400:kworker.0 00000100:00100000:1.0:1789127566.787768:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127566.787804:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789576960 00000100:00100000:1.0:1789127566.787808:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789576960 00000100:00100000:1.0:1789127566.787840:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127566.787848:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789576960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127566.787891:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789576960:12345-0@lo:400:kworker.0 Request processed in 44us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127566.787910:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789127566.787945:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff934587ffbc00 x1876035789576960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127566.787956:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789576960:0@lo:400:kworker.0 00000100:00100000:3.0:1789127566.788087:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789576832:0@lo:38:kworker.0 00000100:00100000:3.0:1789127566.788116:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127566.788725:0:17950:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789127566.788734:0:17950:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1789127566.789799:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789576832 00000100:00100000:1.0:1789127566.789808:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789576832 00000100:00100000:2.0:1789127566.790117:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127566.790127:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1876035789576832:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1789127566.790213:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3649:x1876035789576832:12345-0@lo:38:kworker.0 Request processed in 86us (2096us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789127566.790220:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1789127566.790766:0:17951:0:(import.c:65:import_set_state_nolock()) ffff9346b7dd2800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127566.790816:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7395e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3649:x1876035789576704:12345-0@lo:38:llog_process_th.0 Request processed in 3933us (4044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127566.790824:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127566.790903:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127566.790910:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934588d57800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127566.790915:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789127566.790918:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789576832:0@lo:38:kworker.0 00000100:00100000:3.0:1789127566.790928:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127566.790934:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789127566.790941:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789127566.790945:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789127566.790954:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346b71ec800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789127566.791009:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789576704:0@lo:38:llog_process_th.0 00000040:01000000:0.0:1789127566.791174:0:18684:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789127566.791383:0:18684:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789127566.794255:0:18684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127566.794500:0:18684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789127566.794971:0:18684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1789127566.795255:0:18690:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789127566.795260:0:18690:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789127566.795939:0:18684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789127566.795950:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789127566.795986:0:18684:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789127566.796007:0:18684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd718aadfd785e88a 00000100:00080000:3.0:1789127566.796016:0:18684:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127566.796023:0:18684:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9346c1ef3800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789127566.796056:0:18684:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9346b7397c00 x1876035789577088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127566.796085:0:18684:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789127566.796136:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127566.796140:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127566.796142:0:18684:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789127566.796145:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789127566.796147:0:18684:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:3.0:1789127566.796149:0:18684:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127566.796150:0:18684:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127566.796151:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789127566.796153:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127566.796155:0:18684:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789127566.796157:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789127566.796160:0:18684:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1789127566.796163:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127566.796164:0:18684:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789127566.796167:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789127566.796171:0:18684:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.148@tcp to nid 0x20000c0a8ce94 (192.168.206.148@tcp) 00000020:01000000:3.0:1789127566.796193:0:18684:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789127566.796194:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127566.796205:0:18684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9346a0b5ced8) 00000020:00000080:3.0:1789127566.796223:0:18684:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1789127566.796228:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789127566.796300:0:18684:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1789127566.796306:0:18684:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789127566.796312:0:18684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xd718aadfd785e898 00010000:00080000:3.0:1789127566.796338:0:18684:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9346b5489000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.148@tcp at head 00000100:00080000:1.0:1789127566.796636:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127566.796650:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789127566.796653:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127566.796656:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789127566.796671:0:18684:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1789127566.796735:0:18684:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789127566.796749:0:18684:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1789127566.797551:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789577088:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789127566.797970:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035789577088 offset 0 length 520: 4 00000040:00080000:3.0:1789127566.798371:0:18684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127566.800693:0:18684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1789127566.800863:0:18684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:1.0:1789127566.801651:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127566.801672:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789577216:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127566.801740:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127566.801801:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789577216 00000100:00100000:2.0:1789127566.801809:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789577216 00000100:00100000:2.0:1789127566.801857:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127566.801866:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1876035789577216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127566.801898:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000040:00080000:1.0:1789127566.801947:0:18692:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789127566.801951:0:18692:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1789127566.801990:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1876035789577216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127566.801997:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127566.802008:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789577216:0@lo:41:osp-pre-0-1.0 00000020:00000080:0.0:1789127566.817909:0:18684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789127566.817924:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789127566.817973:0:18684:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789127566.817994:0:18684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd718aadfd785e89f 00000100:00080000:0.0:1789127566.818007:0:18684:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127566.818013:0:18684:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9346b5489000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789127566.818047:0:18684:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934690402580 x1876035789577344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127566.818081:0:18684:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789127566.818138:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127566.818143:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127566.818144:0:18684:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789127566.818147:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127566.818151:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127566.818163:0:18684:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789127566.818167:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789127566.818169:0:18684:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789127566.818171:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127566.818173:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127566.818175:0:18684:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789127566.818177:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789127566.818179:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127566.818180:0:18684:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789127566.818184:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789127566.818213:0:18684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789127566.818215:0:18684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789127566.818217:0:18684:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789127566.818220:0:18684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:0.0:1789127566.818293:0:18680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1789127566.818323:0:18680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789127566.818339:0:18680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501be00/0xd718aadfd785e821 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e828 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.818349:0:18680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93468501be00/0xd718aadfd785e821 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e828 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127566.818357:0:18680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9346c1efc000 from 1 10000000:01000000:0.0:1789127566.818359:0:18680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127566.818384:0:18680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.818392:0:18680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.818403:0:18680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127566.818431:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789577472:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127566.818490:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.818550:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687e36600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127566.818769:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690402580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789577344:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789127566.818799:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035789577344 offset 0 length 520: 4 00000100:00080000:1.0:1789127566.818872:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789127566.818877:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789127566.818886:0:37:0:(import.c:65:import_set_state_nolock()) ffff934588d57800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789127566.818892:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff934588d57800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:1.0:1789127566.818909:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ff8f00 x1876035789577600/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789127566.818931:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127566.818935:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789127566.818938:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127566.818941:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789127566.818975:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789127566.818979:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789127566.818993:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789577856:0@lo:400:kworker.0 00000100:00100000:1.0:1789127566.819023:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127566.819042:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127566.819048:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789577728:0@lo:400:kworker.0 00000100:00100000:1.0:1789127566.819071:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127566.819094:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789577856 00000100:00100000:1.0:1789127566.819100:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789577856 00000100:00100000:1.0:1789127566.819133:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127566.819141:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1876035789577856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127566.819188:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3651:x1876035789577856:12345-0@lo:400:kworker.0 Request processed in 47us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127566.819195:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127566.819227:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789577856:0@lo:400:kworker.0 00000100:00100000:3.0:1789127566.819280:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789577728 00000100:00100000:3.0:1789127566.819285:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789577728 00000100:00100000:3.0:1789127566.819321:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127566.819327:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789577728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127566.819364:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789577728:12345-0@lo:400:kworker.0 Request processed in 37us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127566.819370:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789127566.819396:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff934587ffb0c0 x1876035789577728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127566.819406:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789577728:0@lo:400:kworker.0 00000100:00100000:3.0:1789127566.819425:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789577600:0@lo:38:kworker.0 00000100:00100000:3.0:1789127566.819449:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127566.819476:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789577600 00000100:00100000:3.0:1789127566.819487:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789577600 00000100:00100000:3.0:1789127566.819536:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127566.819541:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1876035789577600:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789127566.819603:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1876035789577600:12345-0@lo:38:kworker.0 Request processed in 61us (153us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789127566.819610:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1789127566.819632:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934588d57800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127566.819636:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789127566.819639:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789577600:0@lo:38:kworker.0 00000100:00100000:2.0:1789127566.819770:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789577472 00000100:00100000:2.0:1789127566.819775:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789577472 00000100:00100000:2.0:1789127566.819813:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789127566.819821:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+15:18680:x1876035789577472:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127566.819830:0:17940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127566.819845:0:17940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9345886d6c00/0xd718aadfd785e8ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e8a6 expref: -99 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127566.819879:0:17940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d6c00/0xd718aadfd785e8ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e8a6 expref: 16 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127566.819889:0:17940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9345886d6c00/0xd718aadfd785e8ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e8a6 expref: 16 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127566.819897:0:17940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6c00, rc 0) 00000100:00100000:2.0:1789127566.819926:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+16:18680:x1876035789577472:12345-0@lo:101:mount.lustre.0 Request processed in 107us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127566.819933:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789127566.822559:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789577472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127566.822596:0:18680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e8ad expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.822609:0:18680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e8ad expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127566.823146:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789577984:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789127566.823209:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.823249:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934687e36600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127566.823636:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789577984 00000100:00100000:2.0:1789127566.823643:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789577984 00000100:00100000:2.0:1789127566.823691:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789127566.823701:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+16:18680:x1876035789577984:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789127566.823720:0:17939:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789127566.823737:0:17939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789127566.823741:0:17939:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789127566.823826:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+16:18680:x1876035789577984:12345-0@lo:256:mount.lustre.0 Request processed in 126us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127566.823835:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789127566.824173:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789577984:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789127566.825056:0:18680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789127566.825117:0:18680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e8ad expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.825129:0:18680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e8ad expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789127566.825189:0:18680:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346c1efc000 from 1 10000000:01000000:3.0:1789127566.825193:0:18680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789127566.825224:0:18680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.825233:0:18680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.825243:0:18680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127566.825268:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73970c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789578112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789127566.825310:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127566.825345:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684afd600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127566.825398:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789578112 00000100:00100000:2.0:1789127566.825405:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789578112 00000100:00100000:2.0:1789127566.825445:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789127566.825454:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+16:18680:x1876035789578112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127566.825465:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127566.825476:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9345886d6e00/0xd718aadfd785e8bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e8b4 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127566.825540:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d6e00/0xd718aadfd785e8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e8b4 expref: 17 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127566.825551:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9345886d6e00/0xd718aadfd785e8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e8b4 expref: 17 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127566.825560:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6e00, rc 0) 00000100:00100000:2.0:1789127566.825609:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:18680:x1876035789578112:12345-0@lo:101:mount.lustre.0 Request processed in 156us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127566.825626:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789127566.829171:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73970c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789578112:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127566.829198:0:18680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e8bb expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.830479:0:18680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e8bb expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127566.830656:0:18680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789127566.830700:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789578240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127566.830759:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.830809:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684ceb780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127566.831172:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789578240 00000100:00100000:3.0:1789127566.831180:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789578240 00000100:00100000:3.0:1789127566.831236:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789127566.831245:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:18680:x1876035789578240:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127566.831352:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:18680:x1876035789578240:12345-0@lo:501:mount.lustre.0 Request processed in 107us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127566.831375:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789127566.831495:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789578240:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127566.831779:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789578368:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127566.831817:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.831880:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684ceb780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127566.834418:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789578368 00000100:00100000:3.0:1789127566.834431:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789578368 00000100:00100000:3.0:1789127566.834496:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789127566.834528:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:18680:x1876035789578368:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127566.835016:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:18680:x1876035789578368:12345-0@lo:503:mount.lustre.0 Request processed in 510us (3196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127566.835025:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789127566.835118:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789578368:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789127566.835463:0:18680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789127566.835557:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789578496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127566.835628:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.835663:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684ceb780 going to sleep for 11 seconds 00000100:00100000:2.0:1789127566.835760:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789578496 00000100:00100000:2.0:1789127566.835766:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789578496 00000100:00100000:2.0:1789127566.835807:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127566.835816:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:18680:x1876035789578496:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127566.835907:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:18680:x1876035789578496:12345-0@lo:502:mount.lustre.0 Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127566.835915:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789127566.836080:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789578496:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127566.836264:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789127566.836290:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1789127566.836304:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1789127566.836317:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1789127566.836336:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1789127566.836351:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1789127566.836363:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1789127566.836377:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 144 off9680 00000040:00080000:0.0:1789127566.836400:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9904 00000040:00080000:0.0:1789127566.836413:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10128 00000040:00080000:0.0:1789127566.836426:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 144 off10272 00000040:00080000:0.0:1789127566.836439:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10496 00000040:00080000:0.0:1789127566.836452:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 224 off10720 00000040:00080000:0.0:1789127566.836465:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10848 00000040:00080000:0.0:1789127566.836476:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 224 off11072 00000040:00080000:0.0:1789127566.836488:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 224 off11296 00000040:00080000:0.0:1789127566.836501:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 128 off11424 00000100:00100000:0.0:1789127566.836558:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789578624:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127566.836610:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.836803:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684ceb780 going to sleep for 11 seconds 00000100:00100000:3.0:1789127566.836861:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789578624 00000100:00100000:3.0:1789127566.836867:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789578624 00000100:00100000:3.0:1789127566.836904:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789127566.836912:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:18680:x1876035789578624:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127566.837005:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:18680:x1876035789578624:12345-0@lo:502:mount.lustre.0 Request processed in 93us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127566.837013:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789127566.837126:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789578624:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127566.837169:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11648 00000040:00080000:0.0:1789127566.837178:0:18680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:1.0:1789127566.840206:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127566.840223:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127566.840226:0:18694:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789127566.840235:0:18694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9346c1efc000 00000020:00000080:1.0:1789127566.840238:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127566.840245:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127566.840247:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127566.840249:0:18694:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789127566.840251:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127566.840253:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127566.840254:0:18694:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789127566.840257:0:18694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9346c1efc000 00000020:00000080:1.0:1789127566.840259:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127566.840316:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127566.840320:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127566.840322:0:18694:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789127566.840325:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127566.840327:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127566.840329:0:18694:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127566.840332:0:18694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346c1efc000 00000020:00000080:1.0:1789127566.840335:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127566.840352:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127566.840355:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127566.840356:0:18694:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127566.840359:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127566.840362:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127566.840363:0:18694:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127566.840367:0:18694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346c1efc000 00000020:00000080:1.0:1789127566.840369:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127566.840383:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127566.840385:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127566.840387:0:18694:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789127566.840390:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127566.840392:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127566.840398:0:18694:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789127566.840403:0:18694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346c1efc000 00000020:00000080:1.0:1789127566.840405:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127566.840421:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127566.840424:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127566.840425:0:18694:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789127566.840428:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789127566.840430:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127566.840432:0:18694:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789127566.840435:0:18694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346c1efc000 00000020:00000080:1.0:1789127566.840437:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789127566.840458:0:18694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789127566.840461:0:18694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789127566.840462:0:18694:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789127566.840466:0:18694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 19 count 19 00000020:01000000:0.0:1789127566.843718:0:18680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789127566.843765:0:18680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127566.843786:0:18680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e8bb expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.843799:0:18680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e8bb expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127566.843869:0:18680:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789127566.843872:0:18680:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9346c1efc000 10000000:01000000:0.0:1789127566.843875:0:18680:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9346c1efc000 10000000:01000000:0.0:1789127566.843878:0:18680:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789127566.843883:0:18680:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9346c1efc000 from 1 10000000:01000000:0.0:1789127566.843886:0:18680:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789127566.843921:0:18680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fec200/0xd718aadfd785e8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.843935:0:18680:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fec200/0xd718aadfd785e8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.843947:0:18680:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fec200/0xd718aadfd785e8c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127566.843970:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789578752:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127566.844030:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.844065:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684cebc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127566.844169:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789578752 00000100:00100000:3.0:1789127566.844177:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789578752 00000100:00100000:3.0:1789127566.844232:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789127566.844242:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:18680:x1876035789578752:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127566.844255:0:17940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127566.844269:0:17940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501a800/0xd718aadfd785e8c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e8c2 expref: -99 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.844293:0:17940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501a800/0xd718aadfd785e8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e8c2 expref: 18 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.844301:0:17940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501a800/0xd718aadfd785e8c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e8c2 expref: 18 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.844316:0:17940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501a800, rc 0) 00000100:00100000:3.0:1789127566.844355:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:18680:x1876035789578752:12345-0@lo:101:mount.lustre.0 Request processed in 115us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127566.844361:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789127566.844462:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789578752:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127566.844476:0:18680:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fec200/0xd718aadfd785e8c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e8c9 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.844485:0:18680:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fec200/0xd718aadfd785e8c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e8c9 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127566.856824:0:18680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1789127566.857100:0:18680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127566.857308:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789127566.857341:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:1.0:1789127566.857357:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:1.0:1789127566.857371:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:1.0:1789127566.857385:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:1.0:1789127566.857396:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:1.0:1789127566.857410:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:1.0:1789127566.857423:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:1.0:1789127566.857451:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:1.0:1789127566.857467:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:1.0:1789127566.857480:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:1.0:1789127566.857492:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:1.0:1789127566.857504:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:1.0:1789127566.857542:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:1.0:1789127566.857556:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:1.0:1789127566.857701:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:1.0:1789127566.857728:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:1.0:1789127566.857741:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:1.0:1789127566.857753:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:1.0:1789127566.857765:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:1.0:1789127566.857778:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:1.0:1789127566.857789:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:1.0:1789127566.857800:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:1.0:1789127566.857812:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:1.0:1789127566.857837:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:1.0:1789127566.857851:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:1.0:1789127566.857862:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:1.0:1789127566.857874:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:1.0:1789127566.857892:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:1.0:1789127566.857897:0:18680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1789127566.857970:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789578880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127566.858032:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127566.858078:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586f41c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127566.858932:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789578880 00000100:00100000:2.0:1789127566.858941:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789578880 00000100:00100000:2.0:1789127566.858997:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789127566.859006:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:18680:x1876035789578880:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127566.859138:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:18680:x1876035789578880:12345-0@lo:501:mount.lustre.0 Request processed in 133us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127566.859145:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789127566.860790:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789578880:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127566.860847:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789579008:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127566.860907:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127566.860945:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586f41c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127566.861197:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789579008 00000100:00100000:0.0:1789127566.861203:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789579008 00000100:00100000:0.0:1789127566.861254:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789127566.861262:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:18680:x1876035789579008:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127566.861366:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:18680:x1876035789579008:12345-0@lo:503:mount.lustre.0 Request processed in 105us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127566.861374:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789127566.861426:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789579008:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789127566.862004:0:18680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789127566.862079:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789579136:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127566.862119:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.862143:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789579136 00000100:00100000:0.0:1789127566.862147:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789579136 00000100:00100000:0.0:1789127566.862264:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789127566.862273:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:18680:x1876035789579136:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127566.862345:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:18680:x1876035789579136:12345-0@lo:502:mount.lustre.0 Request processed in 73us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127566.862353:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789127566.875706:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684cebc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127566.875741:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789579136:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127566.875964:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789127566.875991:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1789127566.876004:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1789127566.876017:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1789127566.876030:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1789127566.876041:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1789127566.876052:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1789127566.876062:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1789127566.876073:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1789127566.876083:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1789127566.876094:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1789127566.876104:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1789127566.876115:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1789127566.876125:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1789127566.876135:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1789127566.876145:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1789127566.876169:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1789127566.876181:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1789127566.876191:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1789127566.876208:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1789127566.876219:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1789127566.876229:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1789127566.876239:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1789127566.876251:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1789127566.876262:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1789127566.876272:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1789127566.876283:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1789127566.876293:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1789127566.876304:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1789127566.876314:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1789127566.876324:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1789127566.876334:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1789127566.876353:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1789127566.876367:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1789127566.876381:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1789127566.876394:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1789127566.876405:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1789127566.876418:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1789127566.876431:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1789127566.876444:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1789127566.876455:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1789127566.876466:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1789127566.876477:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1789127566.876489:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1789127566.876502:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1789127566.876555:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1789127566.881746:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1789127566.881815:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1789127566.881885:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789579264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127566.881955:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.882001:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684cebc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127566.882071:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789579264 00000100:00100000:3.0:1789127566.882079:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789579264 00000100:00100000:3.0:1789127566.882130:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789127566.882139:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:18680:x1876035789579264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127566.882242:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:18680:x1876035789579264:12345-0@lo:502:mount.lustre.0 Request processed in 103us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127566.882250:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789127566.882333:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789579264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127566.882482:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1789127566.882502:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1789127566.883933:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789579392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127566.883988:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.884022:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789579392 00000100:00100000:0.0:1789127566.884028:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789579392 00000100:00100000:0.0:1789127566.884069:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789127566.884077:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:18680:x1876035789579392:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127566.884164:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:18680:x1876035789579392:12345-0@lo:502:mount.lustre.0 Request processed in 87us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127566.884172:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789127566.884211:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684cebc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127566.884227:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789579392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127566.884279:0:18680:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1789127566.884288:0:18680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789127566.901051:0:18700:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789127566.901068:0:18700:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9346a0b59a48) 00000020:00000080:3.0:1789127566.901089:0:18700:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1789127566.901189:0:18700:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9346c1efc000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789127566.901194:0:18700:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9346c1efc000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789127566.901197:0:18700:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9346c1efc000 3 00010000:00080000:3.0:1789127566.901225:0:18700:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9346a0b37800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1789127566.906215:0:18700:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1789127566.906405:0:18700:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1789127566.906449:0:18700:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789127566.906460:0:18700:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xd718aadfd785e8d7 00000100:00080000:3.0:1789127566.906469:0:18700:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127566.906475:0:18700:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9346a0b37800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789127566.906528:0:18700:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9346b73943c0 x1876035789579520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127566.907814:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876035789579520:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789127566.907879:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789127566.910553:0:18700:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789127566.910598:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127566.910604:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127566.910607:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127566.910610:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127566.910624:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127566.910628:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789127566.911027:0:18700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:0.0:1789127566.911868:0:18680:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789127566.911902:0:18680:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789127566.911918:0:18680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fec200/0xd718aadfd785e8c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e8c9 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.911929:0:18680:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fec200/0xd718aadfd785e8c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e8c9 expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789127566.911974:0:18680:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789127566.911977:0:18680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789127566.911978:0:18680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127566.911979:0:18680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127566.911983:0:18680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127566.911985:0:18680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127566.911986:0:18680:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127566.911988:0:18680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127566.911989:0:18680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789127566.911992:0:18680:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1789127566.911995:0:18680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789127566.911996:0:18680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789127566.911997:0:18680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127566.911998:0:18680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127566.911999:0:18680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127566.912000:0:18680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127566.912000:0:18680:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127566.912002:0:18680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127566.912002:0:18680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789127566.912025:0:18680:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789127566.912043:0:18680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789579648:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789127566.912100:0:18680:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.912127:0:18680:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684ceb780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127566.912246:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789579648 00000100:00100000:0.0:1789127566.912252:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789579648 00000100:00100000:0.0:1789127566.912288:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789127566.912297:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:18680:x1876035789579648:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789127566.912321:0:17938:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789127566.912332:0:17938:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1789127566.913463:0:17925:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789127566.913954:0:17938:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789127566.913966:0:17938:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789127566.914050:0:17961:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789127566.914055:0:17961:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789127566.914074:0:17961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914090:0:17961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e7e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e7e2 expref: 18 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914108:0:17961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9345886d6c00/0xd718aadfd785e8ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e8a6 expref: 18 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914115:0:17961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914147:0:17961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9345886d6c00/0xd718aadfd785e8ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785e8a6 expref: 18 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914161:0:17961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9345886d6c00/0xd718aadfd785e8ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785e8a6 expref: 18 pid: 17940 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127566.914175:0:17961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17961:1876035789579776:0@lo:104: 00000100:00100000:0.0:1789127566.914230:0:17961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127566.914276:0:17961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785e7e2 expref: 18 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914284:0:17961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e7e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785e7e2 expref: 18 pid: 17940 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127566.914294:0:17961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17961:1876035789579904:0@lo:104: 00000100:00100000:0.0:1789127566.914313:0:17961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.914327:0:17961:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684ceb300 going to sleep for 11 seconds 00000100:00100000:0.0:1789127566.914363:0:17928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789579776 00000100:00100000:0.0:1789127566.914369:0:17928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789579776 00000100:00100000:0.0:1789127566.914399:0:17928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789579904 00000100:00100000:0.0:1789127566.914401:0:17928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789579904 00000100:00100000:0.0:1789127566.914414:0:17928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127566.914421:0:17928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690401680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+4:17961:x1876035789579776:12345-0@lo:104: 00010000:00010000:0.0:1789127566.914438:0:17928:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e8ad expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914483:0:17928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127566.914489:0:17928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690401680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+4:17961:x1876035789579776:12345-0@lo:104: Request processed in 68us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127566.914496:0:17928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127566.914542:0:17928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127566.914549:0:17928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690402940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+3:17961:x1876035789579904:12345-0@lo:104: 00010000:00010000:0.0:1789127566.914557:0:17928:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e7e9 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914601:0:17928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789127566.914607:0:17928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690402940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+3:17961:x1876035789579904:12345-0@lo:104: Request processed in 59us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127566.914613:0:17928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789127566.914642:0:17961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17961:1876035789579776:0@lo:104: 00000100:00100000:0.0:1789127566.914651:0:17961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17961:1876035789579904:0@lo:104: 00010000:00010000:0.0:1789127566.914669:0:17961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914685:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127566.914691:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e8ad expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914697:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587feda00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127566.914701:0:17933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785e8ad expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914714:0:17933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785e8ad expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127566.914721:0:17933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785e8ad expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127566.914727:0:17933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127566.914754:0:17933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e8ad expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914760:0:17933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127566.914777:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e8ad expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914784:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785e8a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e8ad expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914795:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127566.914798:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e7e9 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914804:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c800 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127566.914807:0:17933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785e7e9 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914814:0:17933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785e7e9 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127566.914820:0:17933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785e7e9 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127566.914831:0:17933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127566.914844:0:17933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e7e9 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914850:0:17933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127566.914856:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e7e9 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914863:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93458858c800/0xd718aadfd785e7e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e7e9 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127566.914875:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127566.914877:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127566.914879:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127566.914885:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127566.914900:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3652:1876035789580032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127566.914929:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.914952:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127566.914958:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3652:1876035789580160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127566.914976:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127566.915243:0:17930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789580032 00000100:00100000:3.0:1789127566.915248:0:17930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789580032 00010000:00010000:3.0:1789127566.915270:0:17930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9345886d6c00/0xd718aadfd785e8ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e8a6 expref: 19 pid: 17940 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127566.915291:0:17930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789580160 00000100:00100000:3.0:1789127566.915293:0:17930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789580160 00010000:00010000:3.0:1789127566.915302:0:17930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e7e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e7e2 expref: 20 pid: 17940 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127566.915313:0:17930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127566.915319:0:17930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690402d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:3652:x1876035789580032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127566.915328:0:17930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127566.915333:0:17930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9345886d6c00/0xd718aadfd785e8ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e8a6 expref: 20 pid: 17940 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915348:0:17930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9345886d6c00/0xd718aadfd785e8ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785e8a6 expref: 20 pid: 17940 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915361:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9345886d6c00/0xd718aadfd785e8ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785e8a6 expref: 20 pid: 17940 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915373:0:17930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127566.915403:0:17930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690402d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+19:3652:x1876035789580032:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127566.915411:0:17930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127566.915424:0:17930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127566.915429:0:17930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:3652:x1876035789580160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127566.915436:0:17930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127566.915440:0:17930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e7e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e7e2 expref: 18 pid: 17940 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915448:0:17930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785e7e2 expref: 18 pid: 17940 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915458:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e7e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785e7e2 expref: 18 pid: 17940 timeout: 628 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915467:0:17930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915475:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789127566.915486:0:17930:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013714757s 00010000:00010000:3.0:1789127566.915495:0:17930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915502:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915529:0:17930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915536:0:17930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915542:0:17930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127566.915546:0:17930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915552:0:17930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915579:0:17930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915587:0:17930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127566.915609:0:17930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:3652:x1876035789580160:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127566.915614:0:17930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789127566.915642:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3652:1876035789580160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127566.915650:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3652:1876035789580032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127566.915667:0:17961:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915683:0:17961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127566.915689:0:17961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587fec600/0xd718aadfd785e8de lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127566.916663:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+16:18680:x1876035789579648:12345-0@lo:253:mount.lustre.0 Request processed in 4360us (4556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127566.916673:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789127566.916756:0:18680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:18680:1876035789579648:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789127566.916767:0:18680:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789127566.916770:0:18680:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789127566.916771:0:18680:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789127566.916778:0:18680:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789127566.916779:0:18680:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789127566.916780:0:18680:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789127566.916781:0:18680:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789127566.916782:0:18680:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789127566.916784:0:18680:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789127566.916785:0:18680:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789127566.916799:0:18680:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789127566.919385:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789579520 00000100:00100000:2.0:1789127566.919399:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789579520 00000100:00100000:2.0:1789127566.919461:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127566.919469:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1876035789579520:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789127566.919497:0:17946:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:2.0:1789127566.919564:0:17946:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xd718aadfd785e8e5 00000004:00100000:2.0:1789127566.919590:0:17946:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789127566.919625:0:17946:0:(import.c:65:import_set_state_nolock()) ffff9346901f5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127566.919700:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3649:x1876035789579520:12345-0@lo:38:llog_process_th.0 Request processed in 231us (11821us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127566.919707:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789127566.920787:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9346b73943c0 x1876035789579520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127566.920799:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127566.920808:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789127566.920816:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789127566.920820:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789127566.920823:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346a0b37800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789127566.920829:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3649:1876035789579520:0@lo:38:llog_process_th.0 00000040:01000000:1.0:1789127566.935167:0:18680:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:1.0:1789127566.935401:0:18708:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:1.0:1789127566.936018:0:18708:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1789127566.937647:0:18680:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789127566.938101:0:18709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18709:1876035789580288:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789127566.938187:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.938228:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789580288 00000100:00100000:0.0:1789127566.938235:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789580288 00000100:00100000:0.0:1789127566.938272:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127566.938281:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690403c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18709:x1876035789580288:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789127566.938400:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690403c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18709:x1876035789580288:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 119us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127566.938408:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127566.938432:0:18709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346989c4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127566.938456:0:18709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18709:1876035789580288:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789127566.938483:0:18709:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789127566.938549:0:18709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18709:1876035789580416:0@lo:1000:lod0001_rec0000.0 00000040:01000000:3.0:1789127566.938786:0:18680:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1789127566.938828:0:18680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789127566.939239:0:18680:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789127566.939246:0:18680:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1789127566.939279:0:18680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127566.940316:0:18680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789127566.940903:0:18680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789127566.940938:0:18680:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1789127566.941028:0:18680:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127566.942556:0:18708:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000100:00100000:0.0:1789127566.942770:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.942810:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789580416 00000100:00100000:0.0:1789127566.942818:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789580416 00000100:00100000:0.0:1789127566.942863:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127566.942872:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690400780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18709:x1876035789580416:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789127566.942992:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690400780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18709:x1876035789580416:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 120us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127566.943012:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127566.943037:0:18709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ac480 going to sleep for 11 seconds 00000100:00100000:0.0:1789127566.943061:0:18709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18709:1876035789580416:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789127566.943131:0:18709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18709:1876035789580544:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789127566.943163:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127566.943239:0:18709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ac000 going to sleep for 11 seconds 00000020:00080000:2.0:1789127566.943327:0:18707:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1789127566.943331:0:18707:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789127566.943402:0:17956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789580544 00000100:00100000:3.0:1789127566.943407:0:17956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789580544 00000100:00100000:3.0:1789127566.943477:0:17956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789127566.943485:0:17956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690401a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18709:x1876035789580544:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:3.0:1789127566.943579:0:17956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690401a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18709:x1876035789580544:12345-0@lo:900:lod0001_rec0000.0 Request processed in 82us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127566.943586:0:17956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789127566.943660:0:18709:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff934690400000 x1876035789580544/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789127582 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127566.943671:0:18709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18709:1876035789580544:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1789127566.943714:0:18709:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878970c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18709:1876035789580672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789127566.943757:0:18709:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127566.943773:0:18709:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b6477cc0 going to sleep for 11 seconds 00000004:00080000:1.0:1789127566.943930:0:18708:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:3.0:1789127566.944124:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789580672 00000100:00100000:3.0:1789127566.944129:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789580672 00000100:00100000:3.0:1789127566.944187:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127566.944195:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:18709:x1876035789580672:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1789127566.944256:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878952c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:18709:x1876035789580672:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 61us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127566.944263:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789127566.944310:0:18709:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878970c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18709:1876035789580672:0@lo:1000:lod0001_rec0000.0 00000040:00080000:2.0:1789127566.944351:0:18709:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127566.946461:0:18709:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789127566.946563:0:18709:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1789127566.946580:0:18709:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:3.0:1789127566.947068:0:18680:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1789127566.948965:0:18680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789127566.967274:0:18680:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789127566.967310:0:18680:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb4b245593988 00100000:10000000:3.0:1789127566.967318:0:18680:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:3.0:1789127566.968750:0:18680:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789127566.968777:0:18680:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789127566.968793:0:18680:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789127566.968810:0:18680:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789127566.981214:0:18680:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127566.981482:0:18680:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789127567.351862:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127567.737755:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00000040:00080000:3.0:1789127567.946907:0:18702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789127568.375838:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789127568.633056:0:17942:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789127568.633064:0:17942:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9346c1efc000 from 8 10000000:01000000:0.0:1789127568.633069:0:17942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127568.633113:0:17942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127568.633124:0:17942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127568.633135:0:17942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127568.633158:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789580800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127568.633224:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127568.633276:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346989c4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789127568.633335:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789580800 00000100:00100000:3.0:1789127568.633343:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789580800 00000100:00100000:3.0:1789127568.633393:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789127568.633403:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+16:17942:x1876035789580800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127568.633415:0:17940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127568.633436:0:17940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501a000/0xd718aadfd785e8f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e8ec expref: -99 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127568.633475:0:17940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501a000/0xd718aadfd785e8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e8ec expref: 17 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127568.633486:0:17940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501a000/0xd718aadfd785e8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e8ec expref: 17 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127568.633495:0:17940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501a000, rc 0) 00000100:00100000:3.0:1789127568.633579:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:17942:x1876035789580800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127568.633587:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789127568.633606:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789580800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127568.633631:0:17942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e8f3 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127568.633642:0:17942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e8f3 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127568.633690:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789580928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789127568.633732:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127568.633762:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b65ad900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127568.633774:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789580928 00000100:00100000:0.0:1789127568.633780:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789580928 00000100:00100000:0.0:1789127568.633830:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789127568.633839:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:17942:x1876035789580928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789127568.633852:0:17939:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789127568.633874:0:17939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789127568.633878:0:17939:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789127568.633974:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:17942:x1876035789580928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127568.633982:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789127568.635698:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789580928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789127568.635754:0:17942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789127568.635762:0:17942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e8f3 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127568.635773:0:17942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e8f3 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127568.635783:0:17942:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789127568.635786:0:17942:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9346b7fe3800 from 8 10000000:01000000:2.0:1789127568.635788:0:17942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789127568.635831:0:17942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127568.635839:0:17942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127568.635847:0:17942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127568.635874:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789581056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127568.635919:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127568.635957:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934698a61a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127568.636374:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789581056 00000100:00100000:0.0:1789127568.636381:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789581056 00000100:00100000:0.0:1789127568.636429:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789127568.636440:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:17942:x1876035789581056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127568.636452:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127568.636464:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fed400/0xd718aadfd785e901 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e8fa expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127568.636486:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fed400/0xd718aadfd785e901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e8fa expref: 18 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127568.636496:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fed400/0xd718aadfd785e901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e8fa expref: 18 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127568.636505:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fed400, rc 0) 00000100:00100000:0.0:1789127568.636602:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:17942:x1876035789581056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127568.636609:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789127568.636744:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789581056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127568.636759:0:17942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e901 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127568.636768:0:17942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e901 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127568.636828:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73943c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789581184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789127568.636860:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127568.636887:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aec3a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127568.637130:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789581184 00000100:00100000:2.0:1789127568.637135:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789581184 00000100:00100000:2.0:1789127568.637173:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789127568.637182:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:17942:x1876035789581184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789127568.637196:0:17940:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789127568.637211:0:17940:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789127568.637214:0:17940:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1789127568.637290:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:17942:x1876035789581184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127568.637298:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789127568.637330:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73943c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789581184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789127568.637372:0:17942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789127568.637379:0:17942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e901 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127568.637388:0:17942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e901 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127568.760906:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00000040:00080000:3.0:1789127568.952381:0:18702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789127569.420206:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127569.783607:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00010000:00010000:2.0:1789127570.425042:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127570.808940:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00000001:02000400:3.0:1789127571.444318:0:18951:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789127571.454737:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127571.831710:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 0 seconds 00000100:00080000:0.0:1789127572.285561:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789127572.285568:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789127572.285571:0:36:0:(import.c:65:import_set_state_nolock()) ffff934588d57800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127572.285582:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff934588d57800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789127572.285619:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9346904021c0 x1876035789581568/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127572.285644:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127572.285648:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127572.285651:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127572.285653:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127572.285674:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127572.285677:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127572.285679:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127572.285682:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789127572.286914:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789581568:0@lo:38:kworker.0 00000100:00100000:3.0:1789127572.286979:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127572.287054:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690401e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789581696:0@lo:400:kworker.0 00000100:00100000:3.0:1789127572.287090:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127572.287118:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127572.287124:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789581824:0@lo:400:kworker.0 00000100:00100000:3.0:1789127572.287145:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127572.287177:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789581568 00000100:00100000:3.0:1789127572.287184:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789581568 00000100:00100000:2.0:1789127572.287383:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127572.287392:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7395a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3649:x1876035789581568:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789127572.287418:0:17951:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:2.0:1789127572.287459:0:17951:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd718aadfd785e908 00000004:00100000:2.0:1789127572.287473:0:17951:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789127572.287478:0:17951:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1789127572.287644:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789581696 00000100:00100000:1.0:1789127572.287649:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789581696 00000100:00100000:1.0:1789127572.287684:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789127572.287692:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789581696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127572.287743:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789581696:12345-0@lo:400:kworker.0 Request processed in 52us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127572.287751:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789127572.287774:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789581312:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127572.287799:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127572.287811:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789581952:0@lo:400:kworker.0 00000100:00100000:1.0:1789127572.287836:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127572.287853:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127572.287859:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789581440:0@lo:400:kworker.0 00000100:00100000:1.0:1789127572.287884:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789127572.287930:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff934690401e00 x1876035789581696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127572.287944:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690401e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789581696:0@lo:400:kworker.0 00000100:00100000:3.0:1789127572.288462:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789581824 00000100:00100000:3.0:1789127572.288469:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789581824 00000100:00100000:3.0:1789127572.288496:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789581312 00000100:00100000:3.0:1789127572.288499:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789581312 00000100:00100000:3.0:1789127572.288533:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127572.288551:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1876035789581824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127572.288599:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3652:x1876035789581824:12345-0@lo:400:kworker.0 Request processed in 59us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127572.288606:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127572.288619:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789127572.288625:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789581312:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127572.288647:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789127572.288680:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789581312:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127572.288686:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789127572.288721:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789581824:0@lo:400:kworker.0 00000100:00100000:2.0:1789127572.289031:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789581952 00000100:00100000:2.0:1789127572.289036:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789581952 00000100:00100000:2.0:1789127572.289072:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127572.289079:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789581952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127572.289116:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789581952:12345-0@lo:400:kworker.0 Request processed in 38us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127572.289123:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127572.289144:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789581440 00000100:00100000:2.0:1789127572.289148:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789581440 00000100:00100000:2.0:1789127572.289173:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789127572.289179:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:3650:x1876035789581440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127572.289397:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789581440:0@lo:400:kworker.0 00000100:00100000:1.0:1789127572.289413:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789581312:0@lo:41:osp-pre-0-1.0 00010000:00080000:1.0:1789127572.289423:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff934587ebfc00 x1876035789581952/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127572.289433:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789581952:0@lo:400:kworker.0 00000100:00100000:2.0:1789127572.289486:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:3650:x1876035789581440:12345-0@lo:400:kworker.0 Request processed in 30us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127572.289496:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:2.0:1789127572.313856:0:17951:0:(import.c:65:import_set_state_nolock()) ffff9346901f3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127572.313944:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7395a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3649:x1876035789581568:12345-0@lo:38:kworker.0 Request processed in 26550us (26963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127572.313955:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789127572.314033:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789127572.314041:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789127572.314046:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789127572.314048:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934588d57800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789127572.314070:0:3649:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000ad5d598b): req@ffff9346904030c0 x1876035789574144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127572.314097:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789581568:0@lo:38:kworker.0 00000100:00100000:3.0:1789127572.314155:0:17990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127572.314182:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127572.314194:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789574144 00000100:00100000:3.0:1789127572.314199:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789574144 00000100:00100000:3.0:1789127572.314345:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789127572.314354:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7395680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17990:x1876035789574144:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789127572.314420:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7395680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17990:x1876035789574144:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 68us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127572.314427:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789127572.314457:0:17990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904030c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17990:1876035789574144:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1789127572.314488:0:17990:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1789127572.314558:0:17990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73970c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17990:1876035789582080:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789127572.314587:0:17990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127572.314605:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346bebce3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127572.314771:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789582080 00000100:00100000:2.0:1789127572.314775:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789582080 00000100:00100000:2.0:1789127572.314798:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789127572.314804:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17990:x1876035789582080:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789127572.314913:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17990:x1876035789582080:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 109us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127572.314931:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789127572.314956:0:17990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73970c0 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17990:1876035789582080:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789127572.315020:0:17990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587897c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17990:1876035789582336:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789127572.315045:0:17990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127572.315058:0:17990:0:(client.c:2715:ptlrpc_set_wait()) set ffff934682abbd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127572.315069:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789582336 00000100:00100000:2.0:1789127572.315072:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789582336 00000100:00100000:2.0:1789127572.315089:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789127572.315096:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17990:x1876035789582336:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789127572.315141:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17990:x1876035789582336:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 45us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127572.315148:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789127572.315169:0:17990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587897c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17990:1876035789582336:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789127572.315207:0:17990:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789127572.315377:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127572.315388:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789582208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127572.315421:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789127572.317637:0:17990:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789127572.317708:0:17990:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1789127572.317713:0:17990:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:2.0:1789127572.317813:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789582208 00000100:00100000:2.0:1789127572.317821:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789582208 00000100:00100000:2.0:1789127572.317856:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127572.317864:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789582208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789127572.317896:0:17951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789127572.322064:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789582208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4190us (6631us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127572.322086:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789127572.328414:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789582208:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1789127572.393925:0:19004:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789127572.394166:0:19004:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789127572.473251:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789127573.226122:0:19054:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127573.226325:0:19054:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789127573.503751:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789127574.134555:0:19102:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb6dab2a0 20000000:00000080:3.0:1789127574.134571:0:19102:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9346b9110000 uarg=0000000000000000 20000000:01000000:3.0:1789127574.134608:0:19102:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789127574.134615:0:19102:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789127574.134619:0:19102:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789127574.135505:0:19103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 19 20000000:00000400:2.0:1789127574.135729:0:19102:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789127574.145253:0:19102:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789127574.145380:0:19102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127574.145398:0:19102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93458858d000/0xd718aadfd785e7b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e7b1 expref: 17 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127574.145419:0:19102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9345886d6e00/0xd718aadfd785e8bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e8b4 expref: 17 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127574.145427:0:19102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127574.145467:0:19102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9345886d6e00/0xd718aadfd785e8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785e8b4 expref: 17 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127574.145482:0:19102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9345886d6e00/0xd718aadfd785e8bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785e8b4 expref: 17 pid: 17938 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127574.145496:0:19102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19102:1876035789582464:0@lo:104: 00000100:00100000:3.0:1789127574.145610:0:19102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789127574.145659:0:19102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93458858d000/0xd718aadfd785e7b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785e7b1 expref: 17 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127574.145668:0:19102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93458858d000/0xd718aadfd785e7b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785e7b1 expref: 17 pid: 17940 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127574.145677:0:19102:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19102:1876035789582592:0@lo:104: 00000100:00100000:3.0:1789127574.145698:0:19102:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127574.145717:0:19102:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684b37180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127574.145867:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789582464 00000100:00100000:0.0:1789127574.145875:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789582464 00000100:00100000:0.0:1789127574.145907:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789582592 00000100:00100000:0.0:1789127574.145910:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789582592 00000100:00100000:0.0:1789127574.145924:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127574.145933:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7397840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+4:19102:x1876035789582464:12345-0@lo:104: 00010000:00010000:0.0:1789127574.145946:0:17929:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e8bb expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146007:0:17929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127574.146019:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7397840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+4:19102:x1876035789582464:12345-0@lo:104: Request processed in 87us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127574.146027:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127574.146042:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127574.146048:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+3:19102:x1876035789582592:12345-0@lo:104: 00010000:00010000:0.0:1789127574.146055:0:17929:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e7b8 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146091:0:17929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789127574.146095:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+3:19102:x1876035789582592:12345-0@lo:104: Request processed in 49us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127574.146101:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789127574.146117:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127574.146122:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e8bb expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146129:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501a400 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127574.146133:0:17933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785e8bb expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146140:0:17933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785e8bb expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127574.146147:0:17933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785e8bb expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127574.146154:0:17933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127574.146179:0:17933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e8bb expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146196:0:17933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127574.146218:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e8bb expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146225:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93468501a400/0xd718aadfd785e8b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e8bb expref: -99 pid: 18680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146237:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127574.146240:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e7b8 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146245:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fecc00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127574.146248:0:17933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785e7b8 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146255:0:17933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785e7b8 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127574.146261:0:17933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785e7b8 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127574.146265:0:17933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789127574.146278:0:17933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e7b8 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146283:0:17933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127574.146290:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e7b8 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146296:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785e7b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e7b8 expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146313:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127574.146315:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127574.146316:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127574.146337:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3652:1876035789582720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127574.146367:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127574.146388:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127574.146394:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3652:1876035789582848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127574.146414:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127574.146453:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789582720 00000100:00100000:0.0:1789127574.146457:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789582720 00010000:00010000:0.0:1789127574.146474:0:17931:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9345886d6e00/0xd718aadfd785e8bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e8b4 expref: 18 pid: 17938 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127574.146492:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789582848 00000100:00100000:0.0:1789127574.146494:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789582848 00010000:00010000:0.0:1789127574.146546:0:17931:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93458858d000/0xd718aadfd785e7b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e7b1 expref: 19 pid: 17940 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127574.146562:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127574.146569:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+19:3652:x1876035789582720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127574.146579:0:17931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127574.146583:0:17931:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9345886d6e00/0xd718aadfd785e8bb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e8b4 expref: 19 pid: 17938 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146593:0:17931:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9345886d6e00/0xd718aadfd785e8bb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785e8b4 expref: 19 pid: 17938 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146606:0:17931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127574.146639:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+19:3652:x1876035789582720:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127574.146645:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127574.146659:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127574.146664:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:3652:x1876035789582848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127574.146671:0:17931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127574.146675:0:17931:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93458858d000/0xd718aadfd785e7b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e7b1 expref: 18 pid: 17940 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146684:0:17931:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93458858d000/0xd718aadfd785e7b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785e7b1 expref: 18 pid: 17940 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146694:0:17931:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146702:0:17931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146713:0:17931:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146720:0:17931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146726:0:17931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146733:0:17931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146739:0:17931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501a200 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127574.146749:0:17931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146757:0:17931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146766:0:17931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127574.146775:0:17931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127574.146800:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:3652:x1876035789582848:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127574.146806:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127574.146840:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3652:1876035789582848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127574.146849:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3652:1876035789582720:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127574.147304:0:19102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9345886d6e00/0xd718aadfd785e8bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785e8b4 expref: 17 pid: 17938 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127574.147316:0:19102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19102:1876035789582464:0@lo:104: 00010000:00010000:3.0:1789127574.147328:0:19102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93458858d000/0xd718aadfd785e7b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785e7b1 expref: 16 pid: 17940 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127574.147349:0:19102:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19102:1876035789582592:0@lo:104: 00010000:00010000:3.0:1789127574.147365:0:19102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127574.147373:0:19102:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127574.147380:0:19102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127574.147386:0:19102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501a200/0xd718aadfd785e90f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127574.149470:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127574.521491:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127575.546864:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789127575.890054:0:17942:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127575.890062:0:17942:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346c1efc000 from 19 10000000:01000000:2.0:1789127575.890067:0:17942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127575.890113:0:17942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127575.890131:0:17942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127575.890142:0:17942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127575.890167:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789582976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127575.890245:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127575.890307:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789582976 00000100:00100000:2.0:1789127575.890314:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789582976 00000100:00100000:2.0:1789127575.890357:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789127575.890581:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+16:17942:x1876035789582976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127575.890594:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127575.890608:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e91d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e916 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127575.890631:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e91d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e916 expref: 17 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127575.890658:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e91d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e916 expref: 17 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127575.890667:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7c00, rc 0) 00000100:00100000:2.0:1789127575.890702:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:17942:x1876035789582976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 336us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127575.890709:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789127575.890762:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934682abb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127575.890783:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789582976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127575.890797:0:17942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e91d expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127575.890806:0:17942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e91d expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127575.890862:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789583104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127575.890892:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127575.890913:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789583104 00000100:00100000:2.0:1789127575.890917:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789583104 00000100:00100000:2.0:1789127575.890942:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789127575.890949:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:17942:x1876035789583104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127575.891044:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:17942:x1876035789583104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127575.891051:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789127575.891076:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934682abb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127575.891087:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789583104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127575.891122:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789583232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127575.891159:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127575.891179:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789583232 00000100:00100000:2.0:1789127575.891183:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789583232 00000100:00100000:2.0:1789127575.891281:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789127575.891288:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:17942:x1876035789583232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127575.891607:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:17942:x1876035789583232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 318us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127575.891614:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789127575.891656:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934682abb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127575.891670:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789583232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789127575.892615:0:19175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789127575.892683:0:17942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789127575.892702:0:17942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127575.892711:0:17942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e91d expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127575.892721:0:17942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e91d expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127575.892731:0:17942:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127575.892733:0:17942:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b7fe3800 from 19 10000000:01000000:2.0:1789127575.892736:0:17942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127575.892763:0:17942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127575.892771:0:17942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127575.892790:0:17942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127575.892808:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789583360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127575.892850:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127575.892876:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934682abb900 going to sleep for 11 seconds 00000100:00100000:2.0:1789127575.892894:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789583360 00000100:00100000:2.0:1789127575.892899:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789583360 00000100:00100000:2.0:1789127575.892937:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789127575.892946:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+17:17942:x1876035789583360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127575.892957:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127575.892969:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9345886d6800/0xd718aadfd785e92b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e924 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127575.892987:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d6800/0xd718aadfd785e92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e924 expref: 18 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127575.892997:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9345886d6800/0xd718aadfd785e92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e924 expref: 18 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127575.893004:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6800, rc 0) 00000100:00100000:2.0:1789127575.893037:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:17942:x1876035789583360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127575.893044:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789127575.893099:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789583360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127575.893111:0:17942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e92b expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127575.893126:0:17942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e92b expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127575.893175:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789583488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127575.895865:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127575.895950:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934682abb900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127575.905819:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789583488 00000100:00100000:0.0:1789127575.905837:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789583488 00000100:00100000:1.0:1789127575.906037:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789127575.906047:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:17942:x1876035789583488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127575.906384:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:17942:x1876035789583488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 338us (10529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127575.906396:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789127575.906491:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789583488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127575.906663:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789583616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127575.906730:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127575.906773:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934682abb900 going to sleep for 11 seconds 00000100:00100000:0.0:1789127575.906892:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789583616 00000100:00100000:0.0:1789127575.906897:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789583616 00000100:00100000:0.0:1789127575.906935:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789127575.906949:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:17942:x1876035789583616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127575.907049:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:17942:x1876035789583616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127575.907056:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789127575.907566:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789583616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789127575.910256:0:19176:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789127575.913154:0:17942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789127575.913186:0:17942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127575.913208:0:17942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e92b expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127575.913230:0:17942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e92b expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127576.382274:0:3649:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127566/real 1789127566] req@ffff934690402580 x1876035789577344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127576 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127576.382302:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff934690402580 x1876035789577344/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127576 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127576.382311:0:3649:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127566/real 1789127566] req@ffff9346b7397c00 x1876035789577088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127576 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127576.382322:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9346b7397c00 x1876035789577088/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127576 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789127576.382338:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346b5489000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127576.382352:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789127576.382355:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690402580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789577344:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789127576.382360:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346c1ef3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789127576.382364:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789127576.382367:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789577088:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789127576.382480:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127576.382484:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127576.382487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127576.382490:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127576.382548:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127576.382552:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789127576.382554:0:37:0:(import.c:65:import_set_state_nolock()) ffff9346c1ef3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127576.382559:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 527 00000100:00080000:2.0:1789127576.382564:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789127576.382570:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9346c1ef3800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789127576.382589:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587895a40 x1876035789584128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127576.382601:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127576.382609:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789127576.382611:0:37:0:(import.c:65:import_set_state_nolock()) ffff9346b5489000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127576.382614:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 528 00000100:00080000:2.0:1789127576.382617:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789127576.382621:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9346b5489000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789127576.382633:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587894f00 x1876035789584256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127576.382665:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789584000:0@lo:400:kworker.0 00000100:00100000:2.0:1789127576.382725:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127576.382754:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127576.382760:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587896d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789584384:0@lo:400:kworker.0 00000100:00100000:2.0:1789127576.382785:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127576.382818:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789584384 00000100:00100000:2.0:1789127576.382825:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789584384 00000100:00100000:2.0:1789127576.382869:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127576.382878:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789584384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127576.382926:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789584384:12345-0@lo:400:kworker.0 Request processed in 48us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127576.382933:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789127576.382968:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff934587896d00 x1876035789584384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127576.382978:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587896d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789584384:0@lo:400:kworker.0 00000100:00100000:3.0:1789127576.383291:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789583872:0@lo:400:kworker.0 00000100:00100000:3.0:1789127576.383324:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127576.383411:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789583744:0@lo:400:kworker.0 00000100:00100000:1.0:1789127576.383443:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127576.383476:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789584128:0@lo:8:kworker.0 00000400:00000100:1.0:1789127576.383500:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035789584128 offset 0 length 520: 4 00000100:00100000:1.0:1789127576.383563:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789584256:0@lo:8:kworker.0 00000400:00000100:1.0:1789127576.383584:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035789584256 offset 0 length 520: 4 00000100:00100000:3.0:1789127576.384854:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789584000 00000100:00100000:3.0:1789127576.384866:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789584000 00000100:00100000:3.0:1789127576.384908:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789583744 00000100:00100000:3.0:1789127576.384912:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789583744 00000100:00100000:3.0:1789127576.384930:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127576.384938:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789584000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127576.385012:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878961c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789584000:12345-0@lo:400:kworker.0 Request processed in 74us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127576.385019:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127576.385034:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127576.385040:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789583744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127576.385076:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789583744:12345-0@lo:400:kworker.0 Request processed in 36us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127576.385091:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127576.385135:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789583744:0@lo:400:kworker.0 00000100:00100000:3.0:1789127576.385163:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789584000:0@lo:400:kworker.0 00000100:00100000:2.0:1789127576.387454:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789583872 00000100:00100000:2.0:1789127576.387465:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789583872 00000100:00100000:2.0:1789127576.387678:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127576.387690:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7396940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789583872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127576.387785:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7396940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789583872:12345-0@lo:400:kworker.0 Request processed in 98us (4460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127576.387793:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789127576.390376:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff934587897840 x1876035789583872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127576.390394:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789583872:0@lo:400:kworker.0 00010000:00010000:0.0:1789127576.567738:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127576.893018:0:17978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789127577.400957:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789584512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127577.401021:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127577.402360:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127577.403849:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789584640:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127577.403917:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127577.404095:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789584512 00000100:00100000:0.0:1789127577.404104:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789584512 00000100:00100000:0.0:1789127577.404181:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789584640 00000100:00100000:0.0:1789127577.404185:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789584640 00000100:00100000:2.0:1789127577.404217:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789127577.404227:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789584512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789127577.404261:0:17951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789127577.404319:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789584512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (3296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127577.404326:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789127577.404345:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127577.404352:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587897c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789584640:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127577.404366:0:17951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789127577.404393:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587897c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789584640:12345-0@lo:41:osp-pre-0-1.0 Request processed in 42us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127577.404399:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789127577.404495:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789584640:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127577.404548:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789584512:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789127577.593640:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789127577.919304:0:18681:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:3.0:1789127578.168231:0:18702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789127578.621441:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127579.453684:0:3649:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127564/real 1789127564] req@ffff934690403840 x1876035789575168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127579 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127579.453714:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff934690403840 x1876035789575168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127579 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127579.453726:0:3649:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127564/real 1789127564] req@ffff934690400b40 x1876035789575296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127579 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127579.453756:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff934690400b40 x1876035789575296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127579 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789127579.453774:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934587f1c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127579.453789:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789127579.453793:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690403840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789575168:0@lo:8:kworker.0 00000100:00080000:2.0:1789127579.453798:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346bea9b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127579.453803:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789127579.453806:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789575296:0@lo:8:kworker.0 00000100:00080000:3.0:1789127579.454740:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127579.454745:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789127579.454748:0:38:0:(import.c:65:import_set_state_nolock()) ffff934587f1c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127579.454753:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 525 00000100:00080000:3.0:1789127579.454758:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789127579.454764:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff934587f1c000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789127579.454781:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9346b7397c00 x1876035789585024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127579.454795:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127579.454798:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789127579.454800:0:38:0:(import.c:65:import_set_state_nolock()) ffff9346bea9b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127579.454803:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 525 00000100:00080000:3.0:1789127579.454805:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789127579.454808:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9346bea9b000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789127579.454819:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9346b73970c0 x1876035789585152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789127579.454846:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127579.454849:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127579.454859:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127579.454862:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789127579.454939:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3652:1876035789584768:0@lo:400:kworker.0 00000100:00100000:3.0:1789127579.455013:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127579.455048:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789585536:0@lo:400:kworker.0 00000100:00100000:3.0:1789127579.455073:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127579.455095:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127579.455101:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7396580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789584896:0@lo:400:kworker.0 00000100:00100000:3.0:1789127579.455123:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127579.455152:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789585280:0@lo:400:kworker.0 00000100:00100000:3.0:1789127579.455184:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127579.455204:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789127579.455209:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789585408:0@lo:400:kworker.0 00000100:00100000:3.0:1789127579.455695:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127579.455733:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789584768 00000100:00100000:3.0:1789127579.455740:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789584768 00000100:00100000:3.0:1789127579.455778:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789127579.455787:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:3652:x1876035789584768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127579.455833:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:3652:x1876035789584768:12345-0@lo:400:kworker.0 Request processed in 48us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127579.455840:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789127579.455869:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789585536 00000100:00100000:3.0:1789127579.455872:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789585536 00000100:00100000:3.0:1789127579.455894:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789585280 00000100:00100000:3.0:1789127579.455897:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789585280 00000100:00100000:3.0:1789127579.455910:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127579.455925:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789585536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127579.455973:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3652:x1876035789585536:12345-0@lo:400:kworker.0 Request processed in 49us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127579.455979:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127579.455991:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127579.455997:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789585280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127579.456027:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789585280:12345-0@lo:400:kworker.0 Request processed in 30us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127579.456033:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127579.456049:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789584896 00000100:00100000:3.0:1789127579.456053:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789584896 00000100:00100000:3.0:1789127579.456071:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789585408 00000100:00100000:3.0:1789127579.456073:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789585408 00000100:00100000:3.0:1789127579.456085:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789127579.456090:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789584896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127579.456120:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789584896:12345-0@lo:400:kworker.0 Request processed in 31us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127579.456126:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789127579.456137:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789127579.456143:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789585408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127579.456168:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789585408:12345-0@lo:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127579.456187:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789127579.456479:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789585408:0@lo:400:kworker.0 00010000:00080000:3.0:1789127579.456496:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff934587ee43c0 x1876035789585280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127579.456550:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789585280:0@lo:400:kworker.0 00000100:00100000:3.0:1789127579.456585:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789585024:0@lo:8:kworker.0 00000400:00000100:3.0:1789127579.456615:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035789585024 offset 0 length 520: 4 00000100:00100000:3.0:1789127579.456630:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b73970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789585152:0@lo:8:kworker.0 00000400:00000100:3.0:1789127579.456648:0:3649:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876035789585152 offset 0 length 520: 4 00000100:00100000:3.0:1789127579.456692:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7396580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789584896:0@lo:400:kworker.0 00000100:00100000:3.0:1789127579.456702:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3652:1876035789584768:0@lo:400:kworker.0 00010000:00080000:3.0:1789127579.456714:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff934587ee5a40 x1876035789585536/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127579.456724:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3652:1876035789585536:0@lo:400:kworker.0 00010000:00010000:0.0:1789127579.641860:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789127580.201424:0:19450:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789127580.201429:0:19450:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789127580.201430:0:19450:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789127580.202033:0:19450:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9346b548a000 00000020:01000004:3.0:1789127580.202051:0:19450:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789127580.202064:0:19450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789127580.202077:0:19450:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9346a0b58000) 00000020:00000080:3.0:1789127580.202094:0:19450:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789127580.280877:0:19450:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789127580.285393:0:19450:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789127580.285745:0:19450:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789127580.286683:0:19450:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789127580.286963:0:19450:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789127580.287703:0:19450:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789127580.287948:0:19450:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1789127580.291936:0:19450:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789127580.292165:0:19450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789127580.292178:0:19450:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789127580.292190:0:19450:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd718aadfd785e939 00000020:01000004:2.0:1789127580.292197:0:19450:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789127580.292219:0:19450:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789127580.292222:0:19450:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789127580.292228:0:19450:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789127580.292233:0:19450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789127580.292244:0:19450:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9346aeecced8) 00000020:00000080:2.0:1789127580.292738:0:19450:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789127580.294001:0:19450:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127580.294143:0:19450:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789127580.294148:0:19450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789127580.298322:0:19450:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789127580.298334:0:19450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789127580.298764:0:19450:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789127580.298770:0:19450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789127580.300071:0:19450:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127580.302750:0:19450:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789127580.302759:0:19450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789127580.305609:0:19450:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789127580.305621:0:19450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789127580.331730:0:19450:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789127580.331976:0:19450:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789127580.331983:0:19450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789127580.333690:0:19450:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789127580.333703:0:19450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789127580.334893:0:19450:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789127580.334903:0:19450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789127580.337202:0:19450:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789127580.337397:0:19450:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789127580.337403:0:19450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789127580.338123:0:19450:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789127580.338130:0:19450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789127580.384119:0:19450:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789127580.384325:0:19450:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789127580.384348:0:19450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789127580.385257:0:19450:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789127580.385267:0:19450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789127580.385941:0:19450:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789127580.385969:0:19450:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789127580.385974:0:19450:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789127580.425546:0:19450:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789127580.425585:0:19450:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.148@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789127580.425590:0:19450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789127580.425591:0:19450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789127580.425593:0:19450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127580.425594:0:19450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127580.425595:0:19450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127580.425596:0:19450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127580.425598:0:19450:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127580.425599:0:19450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127580.425600:0:19450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789127580.425604:0:19450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789127580.425606:0:19450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789127580.425607:0:19450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789127580.425609:0:19450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127580.425610:0:19450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127580.425615:0:19450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127580.425616:0:19450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127580.425617:0:19450:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127580.425618:0:19450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127580.425619:0:19450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789127580.425644:0:19450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789127580.425662:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587896940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789585664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789127580.425733:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127580.425770:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aece5600 going to sleep for 11 seconds 00000100:00100000:0.0:1789127580.425873:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789585664 00000100:00100000:0.0:1789127580.425880:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789585664 00000100:00100000:0.0:1789127580.425937:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789127580.425946:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:19450:x1876035789585664:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789127580.425975:0:17938:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789127580.425979:0:17938:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789127580.425983:0:17938:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789127580.426327:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:19450:x1876035789585664:12345-0@lo:253:mount.lustre.0 Request processed in 381us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127580.426336:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789127580.426457:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587896940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789585664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789127580.426467:0:19450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789127580.426469:0:19450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789127580.426470:0:19450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789127580.426471:0:19450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127580.426472:0:19450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127580.426473:0:19450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127580.426474:0:19450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127580.426475:0:19450:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127580.426476:0:19450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127580.426477:0:19450:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789127580.426693:0:19450:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9346b548a000 from lustre-OST0000 10000000:01000000:2.0:1789127580.426722:0:19450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789127580.426725:0:19450:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789127580.426732:0:19450:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff934587f41a48 local copy 00010000:00010000:2.0:1789127580.426742:0:19450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e6fb expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127580.426834:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587896940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789585792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127580.426864:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127580.426884:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aece5240 going to sleep for 11 seconds 00000100:00100000:0.0:1789127580.426936:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789585792 00000100:00100000:0.0:1789127580.426940:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789585792 00000100:00100000:0.0:1789127580.426975:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789127580.426983:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:19450:x1876035789585792:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127580.427050:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:19450:x1876035789585792:12345-0@lo:501:mount.lustre.0 Request processed in 68us (185us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789127580.427064:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789127580.427160:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587896940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789585792:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789127580.427172:0:19450:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789127580.427194:0:19450:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789127580.427199:0:19450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e6fb expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127580.427207:0:19450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e6fb expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127580.427231:0:19450:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9346b548a000 10000000:01000000:2.0:1789127580.427235:0:19450:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789127580.427240:0:19450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789127580.427242:0:19450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789127580.427246:0:19450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789127580.427249:0:19450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789127580.427267:0:19450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d6600/0xd718aadfd785e947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127580.427275:0:19450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9345886d6600/0xd718aadfd785e947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127580.427282:0:19450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9345886d6600/0xd718aadfd785e947 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127580.427293:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587896940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789585920:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127580.427319:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127580.427348:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aece5240 going to sleep for 11 seconds 00000100:00100000:0.0:1789127580.427393:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789585920 00000100:00100000:0.0:1789127580.427397:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789585920 00000100:00100000:0.0:1789127580.427426:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789127580.427433:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+18:19450:x1876035789585920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127580.427441:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127580.427452:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fed800/0xd718aadfd785e94e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e947 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127580.427471:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fed800/0xd718aadfd785e94e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e947 expref: 19 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127580.427479:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fed800/0xd718aadfd785e94e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e947 expref: 19 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127580.427486:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fed800, rc 0) 00000100:00100000:0.0:1789127580.427555:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+19:19450:x1876035789585920:12345-0@lo:101:mount.lustre.0 Request processed in 121us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127580.427560:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789127580.427649:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587896940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789585920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127580.427661:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9345886d6600/0xd718aadfd785e947 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e94e expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.427669:0:19450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9345886d6600/0xd718aadfd785e947 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e94e expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127580.431050:0:19450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789127580.432088:0:19450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127580.432312:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789127580.432355:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789127580.432371:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789127580.432383:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789127580.432395:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789127580.432408:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789127580.432424:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789127580.432430:0:19450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789127580.432725:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127580.432789:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127580.432883:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127580.436246:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789586048 00000100:00100000:0.0:1789127580.436259:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789586048 00000100:00100000:2.0:1789127580.439850:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789127580.439864:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+19:19450:x1876035789586048:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127580.440058:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+19:19450:x1876035789586048:12345-0@lo:501:mount.lustre.0 Request processed in 197us (7268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127580.440082:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789127580.440173:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127580.440220:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586176:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127580.440265:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127580.440301:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6780 going to sleep for 11 seconds 00000100:00100000:0.0:1789127580.440375:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789586176 00000100:00100000:0.0:1789127580.440381:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789586176 00000100:00100000:0.0:1789127580.440422:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789127580.440430:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+19:19450:x1876035789586176:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127580.442856:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+19:19450:x1876035789586176:12345-0@lo:503:mount.lustre.0 Request processed in 2420us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127580.442868:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789127580.442964:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586176:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789127580.443304:0:19450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789127580.443383:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127580.443436:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127580.443475:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6840 going to sleep for 11 seconds 00000100:00100000:2.0:1789127580.443639:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789586304 00000100:00100000:2.0:1789127580.443646:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789586304 00000100:00100000:2.0:1789127580.443689:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789127580.443697:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+19:19450:x1876035789586304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127580.444073:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+19:19450:x1876035789586304:12345-0@lo:502:mount.lustre.0 Request processed in 376us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127580.444081:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789127580.444174:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586304:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127580.444366:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789127580.444394:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789127580.444410:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789127580.444425:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789127580.444446:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789127580.444461:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789127580.444476:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789127580.444544:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789127580.444562:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789127580.444576:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789127580.444589:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789127580.444604:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789127580.444630:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127580.444674:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127580.444704:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127580.444859:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789586432 00000100:00100000:0.0:1789127580.444864:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789586432 00000100:00100000:0.0:1789127580.444904:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789127580.444912:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+19:19450:x1876035789586432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127580.445001:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+19:19450:x1876035789586432:12345-0@lo:502:mount.lustre.0 Request processed in 88us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127580.445008:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789127580.448167:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127580.448265:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789127580.448279:0:19450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1789127580.452669:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789127580.452681:0:19467:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1789127580.452687:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127580.452689:0:19467:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789127580.452697:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127580.452715:0:19467:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9346a0b5b490) 00000020:00000080:3.0:1789127580.452739:0:19467:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789127580.452745:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789127580.452848:0:19467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9346b548a000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789127580.452856:0:19467:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789127580.452863:0:19467:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd718aadfd785e95c 00010000:00010000:3.0:1789127580.461350:0:19467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1789127580.462353:0:19467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:3.0:1789127580.464214:0:19467:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1789127580.469359:0:19467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789127580.469372:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127580.469379:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127580.469381:0:19467:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789127580.469384:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789127580.469387:0:19467:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1789127580.469389:0:19467:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127580.469390:0:19467:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789127580.469392:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789127580.469394:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127580.469396:0:19467:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789127580.469398:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127580.469400:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127580.469402:0:19467:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789127580.469405:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789127580.469407:0:19467:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789127580.469409:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127580.469411:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127580.469412:0:19467:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789127580.469414:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127580.469416:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127580.469418:0:19467:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789127580.469421:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789127580.469446:0:19467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127580.469450:0:19467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127580.469451:0:19467:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789127580.469454:0:19467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789127580.469885:0:19450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789127580.469915:0:19450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789127580.469978:0:19450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d6600/0xd718aadfd785e947 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e94e expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127580.469990:0:19450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9345886d6600/0xd718aadfd785e947 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e94e expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127580.469998:0:19450:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b548a000 from 1 10000000:01000000:2.0:1789127580.470000:0:19450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127580.470033:0:19450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127580.470041:0:19450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127580.470052:0:19450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127580.470074:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127580.470141:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127580.470176:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789586560 00000100:00100000:2.0:1789127580.470179:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aece56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127580.470182:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789586560 00000100:00100000:0.0:1789127580.470226:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789127580.470235:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+19:19450:x1876035789586560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127580.470248:0:17940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127580.470259:0:17940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fec800/0xd718aadfd785e96a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e963 expref: -99 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127580.470281:0:17940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fec800/0xd718aadfd785e96a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e963 expref: 20 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127580.470291:0:17940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fec800/0xd718aadfd785e96a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e963 expref: 20 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127580.470299:0:17940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec800, rc 0) 00000100:00100000:2.0:1789127580.470419:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586560:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127580.470432:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e96a expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127580.470440:0:19450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e96a expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127580.470481:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:19450:x1876035789586560:12345-0@lo:101:mount.lustre.0 Request processed in 246us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127580.470487:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000040:00080000:2.0:1789127580.471422:0:19450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789127580.471832:0:19450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127580.472032:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789127580.472058:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789127580.472075:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789127580.472081:0:19450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789127580.472146:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127580.472194:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127580.472221:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aece5240 going to sleep for 11 seconds 00000100:00100000:3.0:1789127580.472298:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789586688 00000100:00100000:3.0:1789127580.472310:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789586688 00000100:00100000:3.0:1789127580.472356:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789127580.472364:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:19450:x1876035789586688:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127580.472452:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:19450:x1876035789586688:12345-0@lo:501:mount.lustre.0 Request processed in 88us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127580.472459:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789127580.472906:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127580.472935:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586816:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127580.472973:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127580.473097:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aece5240 going to sleep for 11 seconds 00000100:00100000:1.0:1789127580.473175:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789586816 00000100:00100000:1.0:1789127580.473181:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789586816 00000100:00100000:1.0:1789127580.473225:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789127580.473237:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:19450:x1876035789586816:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127580.473338:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:19450:x1876035789586816:12345-0@lo:503:mount.lustre.0 Request processed in 94us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127580.473352:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789127580.473432:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586816:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789127580.474704:0:19450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127580.474847:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586944:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127580.474909:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127580.474947:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127580.475299:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789586944 00000100:00100000:0.0:1789127580.475306:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789586944 00000100:00100000:0.0:1789127580.475362:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789127580.475372:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:19450:x1876035789586944:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127580.475483:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:19450:x1876035789586944:12345-0@lo:502:mount.lustre.0 Request processed in 113us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127580.475667:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789127580.475701:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789586944:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127580.475951:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789127580.475977:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789127580.475989:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789127580.476001:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789127580.476012:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789127580.476024:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789127580.476035:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789127580.476047:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:2.0:1789127580.476059:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:2.0:1789127580.476071:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:2.0:1789127580.476083:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 144 off10272 00000040:00080000:2.0:1789127580.476094:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10496 00000040:00080000:2.0:1789127580.476105:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10720 00000040:00080000:2.0:1789127580.476132:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 128 off10848 00000040:00080000:2.0:1789127580.476146:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off11072 00000040:00080000:2.0:1789127580.476269:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11296 00000040:00080000:2.0:1789127580.476285:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 128 off11424 00000100:00100000:2.0:1789127580.476311:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789587072:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127580.476408:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127580.476547:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127580.476623:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789587072 00000100:00100000:3.0:1789127580.476628:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789587072 00000100:00100000:3.0:1789127580.476666:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789127580.476675:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:19450:x1876035789587072:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127580.476843:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:19450:x1876035789587072:12345-0@lo:502:mount.lustre.0 Request processed in 169us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127580.476850:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789127580.476920:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789587072:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127580.476961:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11648 00000040:00080000:2.0:1789127580.476969:0:19450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:2.0:1789127580.478036:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127580.478047:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127580.478049:0:19471:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789127580.478055:0:19471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9346b548a000 00000020:00000080:2.0:1789127580.478058:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789127580.478067:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127580.478069:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127580.478076:0:19471:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789127580.478080:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127580.478083:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127580.478084:0:19471:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789127580.478086:0:19471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9346b548a000 00000020:00000080:2.0:1789127580.478089:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789127580.478187:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127580.478191:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127580.478193:0:19471:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789127580.478195:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127580.478198:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127580.478199:0:19471:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789127580.478202:0:19471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b548a000 00000020:00000080:2.0:1789127580.478204:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789127580.479139:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127580.479146:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127580.479148:0:19471:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789127580.479151:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127580.479155:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127580.479156:0:19471:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789127580.479160:0:19471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b548a000 00000020:00000080:2.0:1789127580.479162:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789127580.479187:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127580.479190:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127580.479191:0:19471:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789127580.479193:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127580.479195:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127580.479197:0:19471:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789127580.479200:0:19471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b548a000 00000020:00000080:2.0:1789127580.479202:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789127580.479217:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127580.479220:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127580.479221:0:19471:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789127580.479244:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127580.479247:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127580.479248:0:19471:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789127580.479252:0:19471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9346b548a000 00000020:00000080:2.0:1789127580.479254:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789127580.479283:0:19471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127580.479285:0:19471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127580.479287:0:19471:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789127580.479289:0:19471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000020:01000000:0.0:1789127580.486698:0:19450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789127580.486754:0:19450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127580.486769:0:19450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e96a expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127580.486781:0:19450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e96a expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127580.487629:0:19450:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789127580.487634:0:19450:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9346b548a000 10000000:01000000:0.0:1789127580.487637:0:19450:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9346b548a000 10000000:01000000:0.0:1789127580.487641:0:19450:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789127580.487647:0:19450:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9346b548a000 from 1 10000000:01000000:0.0:1789127580.487649:0:19450:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789127580.487695:0:19450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587feca00/0xd718aadfd785e971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127580.487705:0:19450:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587feca00/0xd718aadfd785e971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127580.487715:0:19450:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587feca00/0xd718aadfd785e971 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127580.487738:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789587200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789127580.487801:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127580.487846:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346829e7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789127580.487909:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789587200 00000100:00100000:1.0:1789127580.487916:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789587200 00000100:00100000:1.0:1789127580.487961:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789127580.487970:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:19450:x1876035789587200:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127580.487982:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127580.487999:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93458858ce00/0xd718aadfd785e978 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e971 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.488021:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93458858ce00/0xd718aadfd785e978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e971 expref: 21 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.488031:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93458858ce00/0xd718aadfd785e978 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e971 expref: 21 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.488038:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858ce00, rc 0) 00000100:00100000:1.0:1789127580.488071:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:19450:x1876035789587200:12345-0@lo:101:mount.lustre.0 Request processed in 103us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127580.488077:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789127580.488393:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789587200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789127580.488406:0:19450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587feca00/0xd718aadfd785e971 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e978 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127580.488415:0:19450:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587feca00/0xd718aadfd785e971 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e978 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127580.492111:0:19450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1789127580.492394:0:19450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789127580.493018:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789127580.493045:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789127580.493059:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789127580.493073:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789127580.493085:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789127580.493098:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789127580.493110:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789127580.493123:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789127580.493135:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789127580.493148:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789127580.493172:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789127580.493187:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789127580.493200:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789127580.493213:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789127580.493226:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789127580.493237:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789127580.493248:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789127580.493262:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789127580.493274:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789127580.493285:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789127580.493297:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789127580.493309:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789127580.493321:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789127580.496096:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789127580.496117:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1789127580.496131:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1789127580.496161:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1789127580.496174:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1789127580.496186:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1789127580.496198:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1789127580.496210:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1789127580.496222:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1789127580.496234:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1789127580.496246:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1789127580.496259:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1789127580.496271:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1789127580.496284:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1789127580.496305:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1789127580.496309:0:19450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1789127580.496409:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789587328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127580.496473:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127580.496541:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789587328 00000100:00100000:3.0:1789127580.496549:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789587328 00000100:00100000:3.0:1789127580.496592:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789127580.496601:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:19450:x1876035789587328:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127580.500469:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:19450:x1876035789587328:12345-0@lo:501:mount.lustre.0 Request processed in 3860us (3987us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127580.500484:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789127580.503619:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346829e7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127580.503663:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789587328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127580.503719:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789587456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127580.503785:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127580.503825:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789587456 00000100:00100000:0.0:1789127580.503830:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789587456 00000100:00100000:0.0:1789127580.503920:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789127580.503931:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:19450:x1876035789587456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789127580.504046:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:19450:x1876035789587456:12345-0@lo:503:mount.lustre.0 Request processed in 117us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127580.504055:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789127580.504148:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346829e7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789127580.504162:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789587456:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789127580.504794:0:19450:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789127580.504861:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789587584:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127580.504909:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127580.504973:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346829e7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127580.505009:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789587584 00000100:00100000:3.0:1789127580.505014:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789587584 00000100:00100000:3.0:1789127580.505047:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789127580.505055:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:19450:x1876035789587584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127580.505179:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:19450:x1876035789587584:12345-0@lo:502:mount.lustre.0 Request processed in 124us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127580.505193:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789127580.505261:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789587584:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127580.505763:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789127580.505805:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789127580.505823:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789127580.505838:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789127580.505851:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789127580.505862:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789127580.505874:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789127580.505887:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789127580.505900:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789127580.505914:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789127580.505928:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789127580.505942:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789127580.505956:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789127580.505968:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789127580.505978:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789127580.505989:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789127580.505999:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789127580.506023:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789127580.506039:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789127580.506052:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789127580.506064:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789127580.506075:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789127580.506089:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789127580.506112:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789127580.506127:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789127580.506141:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789127580.506155:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789127580.506170:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789127580.506183:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789127580.506196:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789127580.506209:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789127580.506223:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789127580.506235:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789127580.506263:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789127580.506280:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789127580.506293:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789127580.506305:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789127580.506318:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789127580.506616:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789127580.506638:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789127580.506653:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789127580.506666:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789127580.506680:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789127580.506696:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789127580.506712:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789127580.506933:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789127580.506951:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789127580.506966:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789127580.507027:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789587712:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127580.507091:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127580.507139:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789587712 00000100:00100000:0.0:1789127580.507144:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789587712 00000100:00100000:0.0:1789127580.507230:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789127580.507240:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:19450:x1876035789587712:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127580.507350:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:19450:x1876035789587712:12345-0@lo:502:mount.lustre.0 Request processed in 111us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127580.507357:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789127580.507919:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346829e7180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127580.507943:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789587712:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127580.508138:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1789127580.508161:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1789127580.508186:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789587840:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127580.508227:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127580.508287:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346829e7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127580.508322:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789587840 00000100:00100000:3.0:1789127580.508476:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789587840 00000100:00100000:0.0:1789127580.508912:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789127580.508922:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:19450:x1876035789587840:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127580.509027:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:19450:x1876035789587840:12345-0@lo:502:mount.lustre.0 Request processed in 107us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127580.509035:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789127580.509087:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebcb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789587840:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789127580.509138:0:19450:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1789127580.509147:0:19450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789127580.513974:0:19476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789127580.513994:0:19476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9346bea51a48) 00000020:00000080:3.0:1789127580.514016:0:19476:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1789127580.514098:0:19476:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9346b548a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789127580.514102:0:19476:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9346b548a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789127580.514105:0:19476:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9346b548a000 3 00010000:00080000:3.0:1789127580.514141:0:19476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff934687bfc000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.148@tcp at head 00010000:00010000:3.0:1789127580.522714:0:19476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1789127580.522911:0:19476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789127580.522953:0:19476:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789127580.522962:0:19476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd718aadfd785e986 00000100:00080000:3.0:1789127580.522972:0:19476:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127580.522978:0:19476:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff934687bfc000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789127580.523010:0:19476:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ee5a40 x1876035789587968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127580.523050:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1876035789587968:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789127580.523121:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127580.523176:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789587968 00000100:00100000:3.0:1789127580.523181:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789587968 00000100:00100000:3.0:1789127580.523205:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127580.523212:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1876035789587968:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789127580.523231:0:17947:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:3.0:1789127580.523264:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd718aadfd785e98d 00000004:00100000:3.0:1789127580.523276:0:17947:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789127580.523310:0:17947:0:(import.c:65:import_set_state_nolock()) ffff93468515f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127580.523590:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3649:x1876035789587968:12345-0@lo:38:llog_process_th.0 Request processed in 376us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127580.523598:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789127580.523631:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff934587ee5a40 x1876035789587968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127580.523641:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127580.523648:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789127580.523654:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789127580.523658:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789127580.523660:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934687bfc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789127580.523666:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3649:1876035789587968:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789127580.523685:0:19476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789127580.524111:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789588096:0@lo:400:kworker.0 00000100:00100000:3.0:1789127580.524147:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789127580.524189:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127580.524193:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127580.524195:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127580.524198:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127580.524225:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127580.524236:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127580.524238:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127580.524241:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789127580.524271:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127580.524277:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789588480:0@lo:400:kworker.0 00000100:00100000:3.0:1789127580.524303:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127580.524356:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789588096 00000100:00100000:3.0:1789127580.524361:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789588096 00000100:00100000:3.0:1789127580.524395:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127580.524402:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789588096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127580.524633:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789588096:12345-0@lo:400:kworker.0 Request processed in 230us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127580.524640:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789127580.524672:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789588480 00000100:00100000:3.0:1789127580.524683:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789588480 00000100:00100000:3.0:1789127580.524709:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127580.524715:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789588480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127580.524750:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789588480:12345-0@lo:400:kworker.0 Request processed in 35us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127580.524757:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789127580.524789:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff934587ebf840 x1876035789588480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127580.524800:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789588480:0@lo:400:kworker.0 00000100:00100000:3.0:1789127580.524811:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789588096:0@lo:400:kworker.0 00000100:00100000:0.0:1789127580.524987:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789588224:0@lo:400:kworker.0 00000100:00100000:0.0:1789127580.525024:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127580.525083:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127580.525089:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789588352:0@lo:400:kworker.0 00000100:00100000:0.0:1789127580.525113:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127580.525146:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789588352 00000100:00100000:0.0:1789127580.525150:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789588352 00000100:00100000:0.0:1789127580.525172:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789127580.525178:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789588352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127580.525210:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789588352:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127580.525215:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789127580.525240:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789588352:0@lo:400:kworker.0 00000100:00100000:3.0:1789127580.525281:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789588224 00000100:00100000:3.0:1789127580.525285:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789588224 00000100:00100000:3.0:1789127580.525305:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127580.525311:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789588224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127580.525683:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789588224:12345-0@lo:400:kworker.0 Request processed in 370us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127580.525690:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000020:01000004:3.0:1789127580.525787:0:19476:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789127580.525801:0:19476:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9346bea53490) 00000020:00000080:3.0:1789127580.525822:0:19476:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1789127580.525891:0:19476:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9346b548a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789127580.525895:0:19476:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9346b548a000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789127580.525897:0:19476:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9346b548a000 3 00010000:00080000:3.0:1789127580.525922:0:19476:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9346c1ef6000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.148@tcp at head 00010000:00080000:0.0:1789127580.527576:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff934587ebe580 x1876035789588224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127596 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127580.527591:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789588224:0@lo:400:kworker.0 00010000:00010000:3.0:1789127580.529204:0:19476:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789127580.529672:0:19476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789127580.529727:0:19476:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789127580.529748:0:19476:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xd718aadfd785e99b 00000100:00080000:3.0:1789127580.529757:0:19476:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789127580.529763:0:19476:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9346c1ef6000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789127580.529796:0:19476:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ee6940 x1876035789588608/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127580.529831:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3649:1876035789588608:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789127580.529897:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127580.529952:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789588608 00000100:00100000:3.0:1789127580.529958:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789588608 00000100:00100000:3.0:1789127580.529988:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789127580.529995:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3649:x1876035789588608:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789127580.530020:0:17947:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 541 last 0 00000020:00000080:3.0:1789127580.530063:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xd718aadfd785e9a2 00000004:00100000:3.0:1789127580.530078:0:17947:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789127580.530108:0:17947:0:(import.c:65:import_set_state_nolock()) ffff9346c1eff800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127580.530156:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3649:x1876035789588608:12345-0@lo:38:llog_process_th.0 Request processed in 161us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127580.530163:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789127580.530199:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff934587ee6940 x1876035789588608/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127580.530208:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127580.530216:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789127580.530222:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789127580.530225:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789127580.530228:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346c1ef6000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789127580.530234:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3649:1876035789588608:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789127580.530259:0:19476:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789127580.530282:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127580.530285:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127580.530288:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127580.530291:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127580.530294:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127580.530296:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127580.530298:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127580.530301:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789127580.532746:0:19476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789127580.534599:0:19450:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789127580.534644:0:19450:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127580.534667:0:19450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587feca00/0xd718aadfd785e971 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e978 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.534680:0:19450:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587feca00/0xd718aadfd785e971 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e978 expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789127580.534736:0:19450:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789127580.534739:0:19450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789127580.534740:0:19450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127580.534741:0:19450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127580.534743:0:19450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127580.534744:0:19450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127580.534745:0:19450:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127580.534747:0:19450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127580.534748:0:19450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127580.534757:0:19450:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1789127580.534759:0:19450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789127580.534760:0:19450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789127580.534761:0:19450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127580.534762:0:19450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127580.534762:0:19450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127580.534764:0:19450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127580.534764:0:19450:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127580.534766:0:19450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127580.534767:0:19450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127580.534796:0:19450:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789127580.534817:0:19450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789588736:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789127580.534893:0:19450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127580.534928:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789588736 00000100:00100000:3.0:1789127580.534938:0:19450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127580.534938:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789588736 00000100:00100000:0.0:1789127580.534999:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789127580.535010:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:19450:x1876035789588736:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789127580.535947:0:17940:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789127580.535974:0:17940:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789127580.549925:0:17940:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789127580.549964:0:17940:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789127580.550231:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:19450:x1876035789588736:12345-0@lo:253:mount.lustre.0 Request processed in 15220us (15335us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127580.550243:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 20000000:01000000:3.0:1789127580.550301:0:17961:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789127580.550306:0:17961:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789127580.550324:0:17961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.550340:0:17961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93468501a000/0xd718aadfd785e8f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e8ec expref: 20 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.550347:0:17961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff934587fed400/0xd718aadfd785e901 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e8fa expref: 20 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.550354:0:17961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.550386:0:17961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff934587fed400/0xd718aadfd785e901 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785e8fa expref: 20 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.550399:0:17961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff934587fed400/0xd718aadfd785e901 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785e8fa expref: 20 pid: 17938 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127580.550436:0:17961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17961:1876035789588864:0@lo:104: 00000100:00100000:3.0:1789127580.550468:0:17961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127580.550629:0:17928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789588864 00000100:00100000:1.0:1789127580.550636:0:17928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789588864 00000100:00100000:1.0:1789127580.550668:0:17928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127580.550674:0:17928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+3:17961:x1876035789588864:12345-0@lo:104: 00010000:00010000:1.0:1789127580.550691:0:17928:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e901 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.550727:0:17928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127580.550732:0:17928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+3:17961:x1876035789588864:12345-0@lo:104: Request processed in 59us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127580.550739:0:17928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789127580.550757:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127580.550763:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e901 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.550770:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7000 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127580.550774:0:17933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785e901 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.550782:0:17933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785e901 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127580.550789:0:17933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785e901 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127580.550794:0:17933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789127580.550820:0:17933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e901 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.550825:0:17933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127580.550844:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e901 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.550850:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785e8fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e901 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.550867:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127580.550869:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127580.550871:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127580.550888:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789588992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127580.550915:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127580.550962:0:17932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789588992 00000100:00100000:1.0:1789127580.550968:0:17932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789588992 00010000:00010000:1.0:1789127580.550983:0:17932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff934587fed400/0xd718aadfd785e901 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e8fa expref: 21 pid: 17938 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127580.551002:0:17932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127580.551009:0:17932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:3653:x1876035789588992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127580.551018:0:17932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127580.551022:0:17932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff934587fed400/0xd718aadfd785e901 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e8fa expref: 21 pid: 17938 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.551032:0:17932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff934587fed400/0xd718aadfd785e901 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785e8fa expref: 21 pid: 17938 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.551046:0:17932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127580.551071:0:17932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:3653:x1876035789588992:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127580.551077:0:17932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789127580.551110:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789588992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127580.551194:0:17961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93468501a000/0xd718aadfd785e8f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785e8ec expref: 20 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.551204:0:17961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93468501a000/0xd718aadfd785e8f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785e8ec expref: 20 pid: 17940 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127580.551213:0:17961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17961:1876035789589120:0@lo:104: 00000100:00100000:3.0:1789127580.551239:0:17961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127580.551263:0:17961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3ad80 going to sleep for 11 seconds 00010000:00010000:3.0:1789127580.551274:0:17961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587fed400/0xd718aadfd785e901 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785e8fa expref: 20 pid: 17938 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127580.551283:0:17961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17961:1876035789588864:0@lo:104: 00000100:00100000:1.0:1789127580.551331:0:17928:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789127580.551340:0:17928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789589120 00000100:00100000:1.0:1789127580.551343:0:17928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789589120 00000100:00100000:1.0:1789127580.551384:0:17928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789127580.551391:0:17928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346bfb5f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+3:17961:x1876035789589120:12345-0@lo:104: 00010000:00010000:1.0:1789127580.551400:0:17928:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e8f3 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127580.551477:0:19450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee6940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:19450:1876035789588736:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789127580.551487:0:19450:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789127580.551490:0:19450:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789127580.551492:0:19450:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789127580.551505:0:19450:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789127580.551506:0:19450:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789127580.551520:0:19450:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789127580.551522:0:19450:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789127580.551524:0:19450:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789127580.551526:0:19450:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789127580.551527:0:19450:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789127580.551538:0:19450:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789127580.551645:0:17928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127580.551651:0:17928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346bfb5f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+3:17961:x1876035789589120:12345-0@lo:104: Request processed in 261us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127580.551658:0:17928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789127580.551693:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127580.551698:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e8f3 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.551705:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed200 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127580.551708:0:17934:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785e8f3 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.551716:0:17934:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785e8f3 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127580.551722:0:17934:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785e8f3 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127580.551727:0:17934:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789127580.551746:0:17934:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e8f3 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.551752:0:17934:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127580.551768:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e8f3 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.551786:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785e8ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e8f3 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127580.551798:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127580.551800:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127580.551802:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127580.551814:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789589248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789127580.551840:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127580.551909:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789589248 00000100:00100000:3.0:1789127580.551914:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789589248 00010000:00010000:3.0:1789127580.551930:0:17931:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93468501a000/0xd718aadfd785e8f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e8ec expref: 20 pid: 17940 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127580.551955:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127580.551961:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458854a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:3650:x1876035789589248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127580.551969:0:17931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127580.551973:0:17931:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93468501a000/0xd718aadfd785e8f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e8ec expref: 20 pid: 17940 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.551982:0:17931:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93468501a000/0xd718aadfd785e8f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785e8ec expref: 20 pid: 17940 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.552001:0:17931:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.552313:0:17931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789127580.552327:0:17931:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013714757s 00010000:00010000:3.0:1789127580.552332:0:17931:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.552340:0:17931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.552347:0:17931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.552354:0:17931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.552365:0:17931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501a200 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127580.552369:0:17931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.552378:0:17931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.552389:0:17931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127580.552399:0:17931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127580.552944:0:17961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501a000/0xd718aadfd785e8f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785e8ec expref: 20 pid: 17940 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127580.552948:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458854a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:3650:x1876035789589248:12345-0@lo:103:ldlm_bl.0 Request processed in 986us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127580.552957:0:17961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17961:1876035789589120:0@lo:104: 00010000:00010000:2.0:1789127580.552974:0:17961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127580.552983:0:17961:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127580.552989:0:17961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127580.553006:0:17961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501a200/0xd718aadfd785e9a9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127580.553020:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127580.553191:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789589248:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789127580.555070:0:19450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789127580.558703:0:19450:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789127580.558713:0:19450:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789127580.558753:0:19450:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789127580.558793:0:19450:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789127580.558809:0:19450:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789127580.558825:0:19450:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789127580.569851:0:19450:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127580.570091:0:19450:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789127580.663740:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789127581.428932:0:19533:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127581.429193:0:19533:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789127581.687636:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789127581.687679:0:17942:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789127581.687683:0:17942:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9346c1efc000 from 9 10000000:01000000:3.0:1789127581.687688:0:17942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789127581.687725:0:17942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127581.687737:0:17942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127581.687747:0:17942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127581.687769:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789589376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789127581.687832:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127581.687875:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346994ad0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789127581.687936:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789589376 00000100:00100000:0.0:1789127581.687943:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789589376 00000100:00100000:0.0:1789127581.687993:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789127581.688002:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+19:17942:x1876035789589376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127581.688015:0:17939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127581.688028:0:17939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fec000/0xd718aadfd785e9b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e9b0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127581.688049:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fec000/0xd718aadfd785e9b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e9b0 expref: 20 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127581.688059:0:17939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fec000/0xd718aadfd785e9b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e9b0 expref: 20 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127581.688067:0:17939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec000, rc 0) 00000100:00100000:0.0:1789127581.688116:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:17942:x1876035789589376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127581.688123:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789127581.688276:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789589376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127581.688353:0:17942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e9b7 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127581.688362:0:17942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e9b7 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127581.688412:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789589504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789127581.688443:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127581.688467:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127581.688544:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789589504 00000100:00100000:0.0:1789127581.688548:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789589504 00000100:00100000:0.0:1789127581.688571:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789127581.688577:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:17942:x1876035789589504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789127581.688588:0:17940:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789127581.688602:0:17940:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789127581.688605:0:17940:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1789127581.688682:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:17942:x1876035789589504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 104us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127581.688688:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789127581.688726:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffb0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789589504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789127581.688777:0:17942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789127581.688784:0:17942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e9b7 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127581.688791:0:17942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e9b7 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127581.688800:0:17942:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789127581.688802:0:17942:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9346b7fe3800 from 9 10000000:01000000:0.0:1789127581.688805:0:17942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127581.688820:0:17942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127581.688827:0:17942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127581.688835:0:17942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127581.688847:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789589632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127581.688869:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127581.688882:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127581.688892:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789589632 00000100:00100000:0.0:1789127581.688895:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789589632 00000100:00100000:0.0:1789127581.688913:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789127581.688918:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:17942:x1876035789589632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127581.688924:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127581.688932:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fede00/0xd718aadfd785e9c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e9be expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127581.688952:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fede00/0xd718aadfd785e9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e9be expref: 21 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127581.688960:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fede00/0xd718aadfd785e9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e9be expref: 21 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127581.688967:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fede00, rc 0) 00000100:00100000:0.0:1789127581.688992:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:17942:x1876035789589632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127581.688997:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789127581.689023:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789589632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127581.689033:0:17942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e9c5 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127581.689040:0:17942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e9c5 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127581.689075:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789589760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789127581.689101:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127581.689113:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72b6840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127581.689122:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789589760 00000100:00100000:0.0:1789127581.689125:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789589760 00000100:00100000:0.0:1789127581.689142:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789127581.689147:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:17942:x1876035789589760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789127581.689155:0:17938:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789127581.689179:0:17938:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789127581.689186:0:17938:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1789127581.689237:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:17942:x1876035789589760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 88us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127581.689243:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789127581.689267:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789589760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789127581.689655:0:17942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789127581.689661:0:17942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e9c5 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127581.689669:0:17942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e9c5 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127582.522655:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127582.522676:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789589888:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127582.522739:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127582.522785:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789589888 00000100:00100000:2.0:1789127582.522792:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789589888 00000100:00100000:2.0:1789127582.522833:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789127582.522842:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789589888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789127582.522871:0:17951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789127582.522913:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789589888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 73us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127582.522921:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789127582.522962:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789589888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127582.523255:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789590016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127582.523301:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127582.523360:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789590016 00000100:00100000:2.0:1789127582.523365:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789590016 00000100:00100000:2.0:1789127582.523391:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789127582.523397:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789590016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127582.523421:0:18689:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789127582.525590:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789590016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2183us (2279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127582.525602:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789127582.533188:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789590016:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789127582.712830:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127583.735593:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127584.761750:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789127585.592133:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127585.592140:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127585.592143:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127585.592146:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127585.592163:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127585.592166:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127585.592169:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127585.592172:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789127585.592212:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789590528:0@lo:400:kworker.0 00000100:00100000:2.0:1789127585.592259:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789590272:0@lo:400:kworker.0 00000100:00100000:0.0:1789127585.592276:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127585.592300:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127585.592353:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789590144:0@lo:400:kworker.0 00000100:00100000:3.0:1789127585.592386:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127585.592414:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789590144 00000100:00100000:3.0:1789127585.592420:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789590144 00000100:00100000:3.0:1789127585.592461:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789127585.592481:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:3653:x1876035789590144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127585.592551:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:3653:x1876035789590144:12345-0@lo:400:kworker.0 Request processed in 82us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127585.592568:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789127585.593860:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789590400:0@lo:400:kworker.0 00000100:00100000:0.0:1789127585.593904:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127585.593935:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789590528 00000100:00100000:0.0:1789127585.593940:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789590528 00000100:00100000:0.0:1789127585.593975:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789590272 00000100:00100000:0.0:1789127585.593978:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789590272 00000100:00100000:0.0:1789127585.593994:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127585.594001:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789590528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127585.594054:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789590528:12345-0@lo:400:kworker.0 Request processed in 53us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127585.594061:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789127585.594077:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789127585.594083:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587895e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789590272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127585.594110:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587895e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789590272:12345-0@lo:400:kworker.0 Request processed in 27us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127585.594115:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789127585.594158:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789590528:0@lo:400:kworker.0 00000100:00100000:3.0:1789127585.594577:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789590400 00000100:00100000:3.0:1789127585.594582:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789590400 00000100:00100000:3.0:1789127585.594614:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127585.594621:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789590400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127585.594662:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789590400:12345-0@lo:400:kworker.0 Request processed in 43us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127585.594668:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127585.594707:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789590144:0@lo:400:kworker.0 00000100:00100000:3.0:1789127585.594715:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789590656:0@lo:400:kworker.0 00000100:00100000:3.0:1789127585.594740:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127585.594775:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789590656 00000100:00100000:3.0:1789127585.594779:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789590656 00000100:00100000:3.0:1789127585.594800:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789127585.594806:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789590656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127585.594838:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789590656:12345-0@lo:400:kworker.0 Request processed in 32us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127585.594844:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789127585.594872:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587ebc3c0 x1876035789590400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127585.594884:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789590400:0@lo:400:kworker.0 00000100:00100000:3.0:1789127585.594891:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789590912:0@lo:400:kworker.0 00000100:00100000:3.0:1789127585.594913:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127585.594940:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789590912 00000100:00100000:3.0:1789127585.594951:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789590912 00000100:00100000:3.0:1789127585.594980:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789127585.594987:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789590912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127585.595017:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3651:x1876035789590912:12345-0@lo:400:kworker.0 Request processed in 31us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127585.595023:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789127585.595048:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587ebe580 x1876035789590656/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127585.595058:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789590656:0@lo:400:kworker.0 00010000:00080000:3.0:1789127585.595075:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587ebf480 x1876035789590912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127585.595083:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3651:1876035789590912:0@lo:400:kworker.0 00000100:00080000:3.0:1789127585.595798:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127585.596341:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789590272:0@lo:400:kworker.0 00000100:00100000:2.0:1789127585.596352:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789590784:0@lo:400:kworker.0 00000100:00100000:2.0:1789127585.596392:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127585.596437:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789590784 00000100:00100000:3.0:1789127585.596443:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789590784 00000100:00100000:3.0:1789127585.596498:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789127585.596506:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587894b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789590784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127585.596568:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587894b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789590784:12345-0@lo:400:kworker.0 Request processed in 62us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127585.596575:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1789127585.597385:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789127585.597412:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587ebd680 x1876035789590784/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127585.597425:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789590784:0@lo:400:kworker.0 00010000:00010000:0.0:1789127585.787154:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789127586.107933:0:17978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1789127586.565735:0:19822:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789127586.808311:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127587.639885:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127587.640410:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789591168:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127587.640543:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127587.640589:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789591040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127587.640628:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127587.642292:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789591168 00000100:00100000:2.0:1789127587.642307:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789591168 00000100:00100000:2.0:1789127587.642367:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789591040 00000100:00100000:2.0:1789127587.642371:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789591040 00000100:00100000:2.0:1789127587.642390:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127587.642400:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789591168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789127587.642446:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789127587.642586:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789591168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 187us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127587.642595:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789127587.642616:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127587.642622:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789591040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789127587.642650:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789127587.642683:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789591040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127587.642690:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789127587.642748:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789591168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127587.642766:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789591040:0@lo:41:osp-pre-1-0.0 00000020:00000004:0.0:1789127587.760934:0:19875:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127587.761884:0:19875:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789127587.832067:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127588.408848:0:18702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1789127588.824344:0:19925:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127588.824867:0:19925:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789127588.855752:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127589.879983:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789127590.714916:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127590.714925:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127590.714928:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127590.714931:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127590.714964:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127590.714968:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127590.714970:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127590.714973:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789127590.715018:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789591424:0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.715122:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127590.715183:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789591936:0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.715213:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127590.715243:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789127590.715249:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3651:1876035789591296:0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.715282:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127590.715310:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789591808:0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.715336:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127590.715363:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789591552:0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.715390:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127590.715409:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789592064:0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.715462:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127590.715477:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127590.715482:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789591680:0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.715506:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127590.715572:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789591424 00000100:00100000:3.0:1789127590.715580:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789591424 00000100:00100000:0.0:1789127590.716415:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789591680 00000100:00100000:0.0:1789127590.716429:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789591680 00000100:00100000:0.0:1789127590.716475:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789127590.716486:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789591424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.716717:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789127590.716727:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789591680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.716807:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789591680:12345-0@lo:400:kworker.0 Request processed in 81us (1299us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127590.716815:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789127590.716846:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789591936 00000100:00100000:3.0:1789127590.716851:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789591936 00000100:00100000:3.0:1789127590.716898:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789591808 00000100:00100000:3.0:1789127590.716902:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789591808 00000100:00100000:3.0:1789127590.716915:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789591552 00000100:00100000:3.0:1789127590.716918:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789591552 00000100:00100000:3.0:1789127590.716927:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789592064 00000100:00100000:3.0:1789127590.716929:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789592064 00000100:00100000:3.0:1789127590.716945:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789127590.716951:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7396580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789591936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.716986:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7396580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789591936:12345-0@lo:400:kworker.0 Request processed in 35us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127590.716993:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789127590.717007:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127590.717014:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789591808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.717042:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789591808:12345-0@lo:400:kworker.0 Request processed in 29us (1706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127590.717065:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127590.717078:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789127590.717084:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789591552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.717296:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789591552:12345-0@lo:400:kworker.0 Request processed in 211us (1904us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127590.717302:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789127590.717316:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127590.717324:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789592064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.717356:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789592064:12345-0@lo:400:kworker.0 Request processed in 34us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127590.717363:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789127590.717386:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789591296 00000100:00100000:3.0:1789127590.717391:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789591296 00000100:00100000:3.0:1789127590.717432:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789127590.717455:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:3651:x1876035789591296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.717492:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:3651:x1876035789591296:12345-0@lo:400:kworker.0 Request processed in 40us (2209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127590.717499:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1789127590.717576:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789127590.717582:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127590.718431:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789591680:0@lo:400:kworker.0 00010000:00080000:3.0:1789127590.718467:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587ee4b40 x1876035789591552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127590.718478:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789591552:0@lo:400:kworker.0 00010000:00080000:3.0:1789127590.718540:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b7394f00 x1876035789592064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127590.718551:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7394f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789592064:0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.718991:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3651:1876035789591296:0@lo:400:kworker.0 00010000:00080000:3.0:1789127590.719009:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587ee6940 x1876035789591808/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127590.719021:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789591808:0@lo:400:kworker.0 00000100:00100000:3.0:1789127590.719036:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789591424:0@lo:400:kworker.0 00010000:00080000:3.0:1789127590.719049:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346b7397840 x1876035789591936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127590.719057:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789591936:0@lo:400:kworker.0 00000100:00100000:0.0:1789127590.720048:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789591424:12345-0@lo:400:kworker.0 Request processed in 3556us (4929us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127590.720062:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:1.0:1789127590.903638:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127591.801617:0:3649:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127576/real 1789127576] req@ffff934587895a40 x1876035789584128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127591 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127591.801655:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff934587895a40 x1876035789584128/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127591 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127591.801665:0:3649:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127576/real 1789127576] req@ffff934587894f00 x1876035789584256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127591 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127591.801674:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff934587894f00 x1876035789584256/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127591 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789127591.801698:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346c1ef3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127591.801731:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789127591.801744:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789584128:0@lo:8:kworker.0 00000100:00080000:3.0:1789127591.801759:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346b5489000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127591.801766:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789127591.801769:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789584256:0@lo:8:kworker.0 00000100:00080000:2.0:1789127591.801979:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127591.801985:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127591.801988:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127591.801991:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789127591.802010:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127591.802013:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789127591.802016:0:38:0:(import.c:65:import_set_state_nolock()) ffff9346c1ef3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127591.802022:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 537 00000100:00080000:2.0:1789127591.802029:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789127591.802037:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9346c1ef3800 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789127591.802062:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587896580 x1876035789592704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789127591.802072:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789127591.802076:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789127591.802078:0:38:0:(import.c:65:import_set_state_nolock()) ffff9346b5489000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789127591.802087:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 537 00000100:00080000:2.0:1789127591.802090:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789127591.802093:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9346b5489000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789127591.802106:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9345878943c0 x1876035789592832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127591.802155:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789592320:0@lo:400:kworker.0 00000100:00100000:2.0:1789127591.802238:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127591.802273:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789593088:0@lo:400:kworker.0 00000100:00100000:2.0:1789127591.802298:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127591.802318:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789127591.802325:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587896d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789592448:0@lo:400:kworker.0 00000100:00100000:2.0:1789127591.802348:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127591.802363:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789593216:0@lo:400:kworker.0 00000100:00100000:2.0:1789127591.802389:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127591.804831:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789592192:0@lo:400:kworker.0 00000100:00100000:3.0:1789127591.804929:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127591.804994:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789592960:0@lo:400:kworker.0 00000100:00100000:3.0:1789127591.805025:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127591.805051:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127591.805059:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789592576:0@lo:400:kworker.0 00000100:00100000:3.0:1789127591.805085:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127591.805140:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789592320 00000100:00100000:3.0:1789127591.805149:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789592320 00000100:00100000:3.0:1789127591.805203:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789592576 00000100:00100000:3.0:1789127591.805206:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789592576 00000100:00100000:3.0:1789127591.805224:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789127591.805233:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789592320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127591.805300:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed13840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789592320:12345-0@lo:400:kworker.0 Request processed in 68us (3062us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127591.805309:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789127591.805330:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789127591.805336:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789592576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127591.805368:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789592576:12345-0@lo:400:kworker.0 Request processed in 32us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127591.805374:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789127591.805404:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789593088 00000100:00100000:3.0:1789127591.805407:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789593088 00000100:00100000:3.0:1789127591.805430:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789592448 00000100:00100000:3.0:1789127591.805445:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789592448 00000100:00100000:3.0:1789127591.805459:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789593216 00000100:00100000:3.0:1789127591.805461:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789593216 00000100:00100000:3.0:1789127591.805472:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789592960 00000100:00100000:3.0:1789127591.805474:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789592960 00000100:00100000:3.0:1789127591.805488:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127591.805494:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789593088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127591.805575:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed130c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789593088:12345-0@lo:400:kworker.0 Request processed in 81us (3275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127591.805581:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127591.805594:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789127591.805599:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789592448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127591.805629:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed12940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789592448:12345-0@lo:400:kworker.0 Request processed in 31us (3281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127591.805636:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789127591.805646:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789127591.805653:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789593216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127591.805681:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed11e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789593216:12345-0@lo:400:kworker.0 Request processed in 29us (3291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127591.805688:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789127591.805698:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789127591.805704:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789592960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127591.805732:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789592960:12345-0@lo:400:kworker.0 Request processed in 28us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127591.805747:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789127591.805791:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789592704:0@lo:8:kworker.0 00000100:00100000:3.0:1789127591.805832:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127591.805861:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789592832:0@lo:8:kworker.0 00000100:00100000:3.0:1789127591.805886:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789127591.805946:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587896d00 x1876035789592448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127591.805963:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587896d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789592448:0@lo:400:kworker.0 00010000:00080000:3.0:1789127591.805977:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346aed10000 x1876035789593216/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127591.805986:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789593216:0@lo:400:kworker.0 00000100:00100000:3.0:1789127591.806000:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789592320:0@lo:400:kworker.0 00010000:00080000:3.0:1789127591.806012:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587895a40 x1876035789593088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127591.806020:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789593088:0@lo:400:kworker.0 00000100:00100000:3.0:1789127591.806068:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789592576:0@lo:400:kworker.0 00010000:00080000:3.0:1789127591.806079:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587894f00 x1876035789592960/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127591.806088:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789592960:0@lo:400:kworker.0 00000100:00100000:2.0:1789127591.806311:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789592192 00000100:00100000:2.0:1789127591.806317:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789592192 00000100:00100000:2.0:1789127591.806362:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789127591.806371:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:3653:x1876035789592192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127591.806422:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:3653:x1876035789592192:12345-0@lo:400:kworker.0 Request processed in 52us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127591.806428:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789127591.806484:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587896940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789592192:0@lo:400:kworker.0 00000100:00100000:2.0:1789127591.813181:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789592704 00000100:00100000:2.0:1789127591.813204:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789592704 00000100:00100000:2.0:1789127591.813254:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789592832 00000100:00100000:2.0:1789127591.813269:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789592832 00000100:00100000:2.0:1789127591.813292:0:19454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127591.813301:0:19454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3649:x1876035789592704:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789127591.813343:0:19454:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:2.0:1789127591.813387:0:19454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd718aadfd785e9cc 00002000:00100000:2.0:1789127591.813407:0:19454:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff934587913800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113987 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1789127591.813412:0:19454:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1789127591.813415:0:19454:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789127591.813674:0:19454:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1789127591.813709:0:19454:0:(import.c:65:import_set_state_nolock()) ffff934587916800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127591.813839:0:19454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3649:x1876035789592704:12345-0@lo:8:kworker.0 Request processed in 537us (8004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127591.813848:0:19454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127591.813872:0:19454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127591.813877:0:19454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3649:x1876035789592832:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789127591.813891:0:19454:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:3.0:1789127591.818245:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587896580 x1876035789592704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127611 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127591.818296:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127591.818310:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1789127591.818320:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789127591.818327:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789127591.818332:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346c1ef3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789127591.818679:0:18691:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789127591.818708:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18691:1876035789593472:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1789127591.818804:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127591.818842:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b54bc900 going to sleep for 11 seconds 00000100:00100000:1.0:1789127591.818872:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789127591.818888:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ff83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789593344:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789127591.818917:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127591.818961:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789593344 00000100:00100000:1.0:1789127591.818968:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789593344 00000100:00100000:1.0:1789127591.819034:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789127591.819044:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1876035789593344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127591.819078:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789127591.819128:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3653:x1876035789593344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127591.819137:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789127591.819178:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587ff83c0 x1876035789593344/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127607 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127591.819211:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ff83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789593344:0@lo:13:osp-pre-0-1.0 00000004:00080000:3.0:1789127591.820662:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789127591.820679:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789592704:0@lo:8:kworker.0 00000100:00080000:3.0:1789127591.820728:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789127591.822112:0:19456:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789127591.822130:0:19456:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:0.0:1789127591.822482:0:18690:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789127591.822629:0:18690:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 553015119116ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789127591.822638:0:18690:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1789127591.826827:0:18681:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:3.0:1789127591.832599:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789593472 00000100:00100000:3.0:1789127591.832617:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789593472 00000100:00100000:1.0:1789127591.832980:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127591.832995:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18691:x1876035789593472:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:1.0:1789127591.834926:0:20028:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789127591.834935:0:20028:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789127591.835111:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18691:x1876035789593472:12345-0@lo:7:osp-pre-0-1.0 Request processed in 2115us (16303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127591.835125:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789127591.850122:0:18691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587ffa580 x1876035789593472/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789127607 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127591.850146:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18691:1876035789593472:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1789127591.850167:0:18691:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:3.0:1789127591.850223:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18691:1876035789593600:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1789127591.850273:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127591.850308:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346828a0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127591.850329:0:19454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3649:x1876035789592832:12345-0@lo:8:kworker.0 Request processed in 36449us (44440us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789127591.850338:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789593600 00000100:00100000:2.0:1789127591.850340:0:19454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789127591.850344:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789593600 00000100:00080000:2.0:1789127591.850392:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346b5489000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1789127591.850396:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789127591.850398:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789127591.850402:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789592832:0@lo:8:kworker.0 00000100:00100000:3.0:1789127591.850404:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:18691:x1876035789593600:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1789127591.850475:0:19456:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1789127591.850543:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:18691:x1876035789593600:12345-0@lo:5:osp-pre-0-1.0 Request processed in 138us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127591.850557:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789127591.850781:0:18691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345878ce940 x1876035789593600/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127607 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127591.850792:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18691:1876035789593600:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1789127591.850810:0:18691:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1789127591.850852:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed103c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18691:1876035789593728:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789127591.851300:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127591.851337:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346900ce840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127591.851424:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789593728 00000100:00100000:0.0:1789127591.851431:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789593728 00000100:00100000:0.0:1789127591.851494:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127591.851503:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed11680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18691:x1876035789593728:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789127591.851634:0:20028:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1789127591.903156:0:19451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789127591.903182:0:19451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1789127591.903463:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed11680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:18691:x1876035789593728:12345-0@lo:5:osp-pre-0-1.0 Request processed in 51954us (52557us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789127591.903477:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789127591.903672:0:18691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346aed103c0 x1876035789593728/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789127607 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127591.903696:0:18691:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789127591.903705:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed103c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18691:1876035789593728:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789127591.903729:0:18691:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:0.0:1789127591.903800:0:18691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:18691:1876035789593856:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789127591.903846:0:18691:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127591.903895:0:18691:0:(client.c:2715:ptlrpc_set_wait()) set ffff934692ad23c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127591.903966:0:17956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789593856 00000100:00100000:1.0:1789127591.903974:0:17956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789593856 00000100:00100000:1.0:1789127591.904029:0:17956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789127591.904039:0:17956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18691:x1876035789593856:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789127591.904092:0:17956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18691:x1876035789593856:12345-0@lo:900:osp-pre-0-1.0 Request processed in 55us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127591.904099:0:17956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789127591.904378:0:18691:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587ebed00 x1876035789593856/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789127607 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127591.904392:0:18691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebed00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:18691:1876035789593856:0@lo:900:osp-pre-0-1.0 00010000:00010000:2.0:1789127591.929733:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127592.760503:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127592.760549:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789593984:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127592.760675:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127592.760722:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789594112:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127592.760747:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127592.760782:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789593984 00000100:00100000:3.0:1789127592.760789:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789593984 00000100:00100000:3.0:1789127592.760826:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789594112 00000100:00100000:3.0:1789127592.760829:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789594112 00000100:00100000:3.0:1789127592.760844:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789127592.760852:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789593984:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127592.761146:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789127592.761156:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789594112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127592.761185:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789127592.761232:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789594112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127592.761239:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00000024:3.0:1789127592.761591:0:17951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127592.763700:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789593984:12345-0@lo:41:osp-pre-1-0.0 Request processed in 2839us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127592.763714:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789127592.763793:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789594112:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127592.768295:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789593984:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789127592.951605:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127593.975712:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127594.999605:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127596.023729:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789127596.344334:0:17978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:1.0:1789127596.457268:0:20271:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789127596.457272:0:20271:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789127596.457274:0:20271:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789127596.457374:0:20271:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff934587b44000 00000020:01000004:1.0:1789127596.457389:0:20271:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789127596.457419:0:20271:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789127596.457435:0:20271:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9346b64f8000) 00000020:00000080:1.0:1789127596.457451:0:20271:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789127596.522911:0:20271:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789127596.526016:0:20271:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789127596.526498:0:20271:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789127596.526984:0:20271:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789127596.527402:0:20271:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1789127596.530025:0:20271:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789127596.530777:0:20271:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1789127596.543044:0:20271:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789127596.543804:0:20271:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789127596.543829:0:20271:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789127596.543842:0:20271:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd718aadfd785e9da 00000020:01000004:3.0:1789127596.543850:0:20271:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789127596.543871:0:20271:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.148@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789127596.543880:0:20271:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.148@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789127596.543887:0:20271:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789127596.543932:0:20271:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789127596.543936:0:20271:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.148@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789127596.567594:0:20271:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.148@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789127596.567632:0:20271:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.148@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789127596.567641:0:20271:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789127596.567643:0:20271:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789127596.567644:0:20271:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127596.567645:0:20271:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127596.567646:0:20271:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127596.567648:0:20271:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127596.567649:0:20271:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127596.567651:0:20271:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127596.567652:0:20271:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789127596.567655:0:20271:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789127596.567657:0:20271:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789127596.567658:0:20271:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789127596.567659:0:20271:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127596.567660:0:20271:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127596.567661:0:20271:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127596.567662:0:20271:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127596.567663:0:20271:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127596.567664:0:20271:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127596.567665:0:20271:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789127596.567689:0:20271:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789127596.567707:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789594240:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789127596.567773:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127596.567824:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346994ade40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127596.567964:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789594240 00000100:00100000:2.0:1789127596.567972:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789594240 00000100:00100000:2.0:1789127596.568027:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789127596.568036:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:20271:x1876035789594240:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789127596.568067:0:17938:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789127596.568071:0:17938:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1789127596.568075:0:17938:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789127596.568788:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:20271:x1876035789594240:12345-0@lo:253:mount.lustre.0 Request processed in 751us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127596.568798:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789127596.568959:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789594240:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789127596.568971:0:20271:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789127596.568973:0:20271:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789127596.568975:0:20271:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789127596.568976:0:20271:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789127596.568977:0:20271:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789127596.568978:0:20271:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789127596.568979:0:20271:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789127596.568980:0:20271:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789127596.568982:0:20271:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789127596.568983:0:20271:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789127596.569000:0:20271:0:(tgt_mount.c:101:server_register_mount()) register mount ffff934587b44000 from lustre-OST0001 10000000:01000000:1.0:1789127596.569026:0:20271:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789127596.569029:0:20271:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789127596.569048:0:20271:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff934587f41a48 local copy 00010000:00010000:1.0:1789127596.569059:0:20271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e6fb expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127596.569231:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789594368:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127596.569266:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127596.569299:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346994ad600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127596.569384:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789594368 00000100:00100000:2.0:1789127596.569389:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789594368 00000100:00100000:2.0:1789127596.569440:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789127596.569456:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:20271:x1876035789594368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127596.570087:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:20271:x1876035789594368:12345-0@lo:501:mount.lustre.0 Request processed in 621us (809us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127596.570096:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789127596.571492:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789594368:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789127596.571541:0:20271:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.148@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789127596.571576:0:20271:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.148@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789127596.571585:0:20271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e6fb expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127596.571595:0:20271:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fec400/0xd718aadfd785e6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e6fb expref: -99 pid: 17924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127596.571625:0:20271:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff934587b44000 10000000:01000000:1.0:1789127596.571631:0:20271:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789127596.571636:0:20271:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789127596.571639:0:20271:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789127596.571643:0:20271:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789127596.571645:0:20271:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789127596.571897:0:20271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858c000/0xd718aadfd785e9e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127596.571905:0:20271:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff93458858c000/0xd718aadfd785e9e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127596.571915:0:20271:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff93458858c000/0xd718aadfd785e9e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127596.571945:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789594496:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789127596.571996:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127596.572039:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346994ad600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127596.572114:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789594496 00000100:00100000:2.0:1789127596.572120:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789594496 00000100:00100000:2.0:1789127596.572170:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789127596.572180:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:20271:x1876035789594496:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127596.572192:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127596.572204:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9345886d6000/0xd718aadfd785e9e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e9e1 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.572225:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d6000/0xd718aadfd785e9e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e9e1 expref: 22 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.572235:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9345886d6000/0xd718aadfd785e9e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e9e1 expref: 22 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.572243:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6000, rc 0) 00000100:00100000:2.0:1789127596.572285:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:20271:x1876035789594496:12345-0@lo:101:mount.lustre.0 Request processed in 107us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127596.572292:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789127596.572779:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789594496:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789127596.572795:0:20271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff93458858c000/0xd718aadfd785e9e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e9e8 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127596.572804:0:20271:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff93458858c000/0xd718aadfd785e9e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785e9e8 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127596.573972:0:20271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1789127596.575063:0:20271:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127596.578912:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1789127596.578962:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1789127596.578979:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1789127596.578994:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1789127596.579007:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1789127596.579023:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1789127596.579051:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1789127596.579058:0:20271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1789127596.579238:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789594624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127596.579305:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127596.579396:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff93469017f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127596.579503:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789594624 00000100:00100000:2.0:1789127596.579640:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789594624 00000100:00100000:2.0:1789127596.579816:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789127596.579825:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:20271:x1876035789594624:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127596.579965:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:20271:x1876035789594624:12345-0@lo:501:mount.lustre.0 Request processed in 140us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127596.579984:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789127596.580053:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789594624:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789127596.580095:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789594752:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789127596.580133:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127596.580275:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff93469017f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789127596.580343:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789594752 00000100:00100000:3.0:1789127596.580349:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789594752 00000100:00100000:3.0:1789127596.580373:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789127596.580380:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:20271:x1876035789594752:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127596.581391:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:20271:x1876035789594752:12345-0@lo:503:mount.lustre.0 Request processed in 1007us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127596.581417:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789127596.581807:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789594752:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789127596.582309:0:20271:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789127596.582393:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789594880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127596.582881:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127596.582974:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a06ae600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127596.583013:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789594880 00000100:00100000:2.0:1789127596.583021:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789594880 00000100:00100000:2.0:1789127596.583188:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789127596.583198:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:20271:x1876035789594880:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127596.583755:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:20271:x1876035789594880:12345-0@lo:502:mount.lustre.0 Request processed in 557us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127596.583764:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789127596.583877:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789594880:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127596.584072:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789127596.584115:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789127596.584130:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789127596.584143:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789127596.584156:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789127596.584169:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789127596.584181:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789127596.584193:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789127596.584206:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1789127596.584236:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127596.584276:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127596.584917:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a06ae600 going to sleep for 11 seconds 00000100:00100000:3.0:1789127596.584996:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789595008 00000100:00100000:3.0:1789127596.585004:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789595008 00000100:00100000:3.0:1789127596.585048:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789127596.585057:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:20271:x1876035789595008:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127596.585294:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:20271:x1876035789595008:12345-0@lo:502:mount.lustre.0 Request processed in 237us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127596.585302:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789127596.585396:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ffa580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789127596.585472:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1789127596.585482:0:20271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:3.0:1789127596.586428:0:20275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789127596.586436:0:20275:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1789127596.586443:0:20275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127596.586445:0:20275:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789127596.586450:0:20275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789127596.586465:0:20275:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9346bea50000) 00000020:00000080:3.0:1789127596.586490:0:20275:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789127596.586497:0:20275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789127596.586609:0:20275:0:(tgt_mount.c:153:server_get_mount()) get mount ffff934587b44000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789127596.586619:0:20275:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789127596.586625:0:20275:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd718aadfd785e9f6 00010000:00010000:3.0:1789127596.591935:0:20275:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:3.0:1789127596.592487:0:20275:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1789127596.594290:0:20275:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1789127596.602007:0:20275:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789127596.602022:0:20275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127596.602029:0:20275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127596.602031:0:20275:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789127596.602035:0:20275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127596.602038:0:20275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127596.602040:0:20275:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789127596.602043:0:20275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789127596.602045:0:20275:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789127596.602048:0:20275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127596.602050:0:20275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127596.602051:0:20275:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789127596.602054:0:20275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789127596.602056:0:20275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127596.602058:0:20275:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789127596.602061:0:20275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789127596.602089:0:20275:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789127596.602092:0:20275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789127596.602094:0:20275:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789127596.602097:0:20275:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789127596.602615:0:20271:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789127596.602647:0:20271:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789127596.602782:0:20271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff93458858c000/0xd718aadfd785e9e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e9e8 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.602795:0:20271:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff93458858c000/0xd718aadfd785e9e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785e9e8 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127596.602802:0:20271:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934587b44000 from 1 10000000:01000000:2.0:1789127596.602805:0:20271:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127596.602839:0:20271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.602848:0:20271:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.602858:0:20271:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127596.602881:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595136:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127596.602956:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127596.602994:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685297b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127596.603799:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789595136 00000100:00100000:3.0:1789127596.603808:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789595136 00000100:00100000:3.0:1789127596.603851:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789127596.603860:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:20271:x1876035789595136:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789127596.603873:0:17939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127596.603886:0:17939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501b400/0xd718aadfd785ea04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785e9fd expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127596.603908:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501b400/0xd718aadfd785ea04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785e9fd expref: 23 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127596.603927:0:17939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501b400/0xd718aadfd785ea04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e9fd expref: 23 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127596.603935:0:17939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b400, rc 0) 00000100:00100000:3.0:1789127596.603980:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:20271:x1876035789595136:12345-0@lo:101:mount.lustre.0 Request processed in 121us (1023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127596.603987:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789127596.604098:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595136:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127596.604114:0:20271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ea04 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.604123:0:20271:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785ea04 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789127596.607060:0:20271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789127596.607328:0:20271:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789127596.607863:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789127596.607891:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789127596.607910:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789127596.607915:0:20271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789127596.607990:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ced00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127596.608052:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127596.608190:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789595264 00000100:00100000:2.0:1789127596.608198:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789595264 00000100:00100000:2.0:1789127596.608247:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789127596.608256:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:20271:x1876035789595264:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127596.608359:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:20271:x1876035789595264:12345-0@lo:501:mount.lustre.0 Request processed in 104us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127596.608367:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789127596.610977:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346900ce240 going to sleep for 11 seconds 00000100:00100000:3.0:1789127596.611016:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ced00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595264:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789127596.611072:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ced00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595392:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127596.611223:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127596.611260:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346900ce240 going to sleep for 11 seconds 00000100:00100000:0.0:1789127596.611325:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789595392 00000100:00100000:0.0:1789127596.611331:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789595392 00000100:00100000:3.0:1789127596.611617:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789127596.611629:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:20271:x1876035789595392:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789127596.611952:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:20271:x1876035789595392:12345-0@lo:503:mount.lustre.0 Request processed in 325us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127596.611959:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789127596.612025:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ced00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595392:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789127596.612760:0:20271:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789127596.612829:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595520:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789127596.612954:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127596.612993:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff934688af3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127596.613030:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789595520 00000100:00100000:2.0:1789127596.613037:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789595520 00000100:00100000:2.0:1789127596.613089:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789127596.613099:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:20271:x1876035789595520:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127596.613213:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:20271:x1876035789595520:12345-0@lo:502:mount.lustre.0 Request processed in 115us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127596.613222:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789127596.613241:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595520:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789127596.613964:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789127596.613992:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789127596.614005:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789127596.614017:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789127596.614028:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789127596.614041:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789127596.614053:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789127596.614065:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:3.0:1789127596.614078:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:3.0:1789127596.614091:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:3.0:1789127596.614104:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 144 off10272 00000040:00080000:3.0:1789127596.614116:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10496 00000040:00080000:3.0:1789127596.614129:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10720 00000040:00080000:3.0:1789127596.614157:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 128 off10848 00000040:00080000:3.0:1789127596.614172:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off11072 00000040:00080000:3.0:1789127596.614188:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11296 00000040:00080000:3.0:1789127596.614202:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 128 off11424 00000100:00100000:3.0:1789127596.614230:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789127596.614276:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127596.614295:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346900ce6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127596.614928:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789595648 00000100:00100000:2.0:1789127596.614935:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789595648 00000100:00100000:2.0:1789127596.614980:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789127596.614989:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:20271:x1876035789595648:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127596.615099:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:20271:x1876035789595648:12345-0@lo:502:mount.lustre.0 Request processed in 110us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127596.615107:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789127596.615271:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ccb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595648:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127596.615325:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11648 00000040:00080000:2.0:1789127596.615334:0:20271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:2.0:1789127596.618316:0:20279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127596.618328:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127596.618330:0:20279:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789127596.618338:0:20279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff934587b44000 00000020:00000080:2.0:1789127596.618341:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789127596.618348:0:20279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127596.618351:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127596.618353:0:20279:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789127596.618355:0:20279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127596.618358:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127596.618359:0:20279:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789127596.618362:0:20279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff934587b44000 00000020:00000080:2.0:1789127596.618364:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789127596.618438:0:20279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127596.618442:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127596.618444:0:20279:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789127596.618446:0:20279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127596.618449:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127596.618450:0:20279:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789127596.618454:0:20279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff934587b44000 00000020:00000080:2.0:1789127596.618456:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789127596.618475:0:20279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127596.618478:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127596.618479:0:20279:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789127596.618482:0:20279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127596.618492:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127596.618494:0:20279:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789127596.618498:0:20279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff934587b44000 00000020:00000080:2.0:1789127596.618500:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789127596.618551:0:20279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127596.618555:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127596.618556:0:20279:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789127596.618559:0:20279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127596.618561:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127596.618562:0:20279:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789127596.618566:0:20279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff934587b44000 00000020:00000080:2.0:1789127596.618568:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789127596.618585:0:20279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127596.618588:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127596.618589:0:20279:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789127596.618592:0:20279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789127596.618594:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127596.618595:0:20279:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789127596.618598:0:20279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff934587b44000 00000020:00000080:2.0:1789127596.618600:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789127596.618621:0:20279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789127596.618624:0:20279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789127596.618626:0:20279:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789127596.618628:0:20279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000020:01000000:2.0:1789127596.624668:0:20271:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:2.0:1789127596.624714:0:20271:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127596.624741:0:20271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ea04 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.624753:0:20271:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ea04 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127596.624834:0:20271:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789127596.624837:0:20271:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff934587b44000 10000000:01000000:2.0:1789127596.624840:0:20271:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff934587b44000 10000000:01000000:2.0:1789127596.624844:0:20271:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789127596.624851:0:20271:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff934587b44000 from 1 10000000:01000000:2.0:1789127596.624853:0:20271:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789127596.624886:0:20271:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785ea0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.624894:0:20271:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785ea0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.624904:0:20271:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785ea0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127596.624927:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595776:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789127596.624989:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127596.625031:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789595776 00000100:00100000:2.0:1789127596.625038:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789595776 00000100:00100000:2.0:1789127596.625094:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789127596.625103:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:20271:x1876035789595776:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127596.625115:0:17939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127596.625126:0:17939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9345886d6400/0xd718aadfd785ea12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785ea0b expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.625155:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d6400/0xd718aadfd785ea12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785ea0b expref: 24 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.625175:0:17939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9345886d6400/0xd718aadfd785ea12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785ea0b expref: 24 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.625183:0:17939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d6400, rc 0) 00000100:00100000:2.0:1789127596.625215:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:20271:x1876035789595776:12345-0@lo:101:mount.lustre.0 Request processed in 113us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127596.625222:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789127596.625264:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127596.625284:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595776:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789127596.625298:0:20271:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785ea0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ea12 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.625306:0:20271:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785ea0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785ea12 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789127596.627918:0:20271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:2.0:1789127596.628214:0:20271:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789127596.628429:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789127596.628454:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789127596.628469:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789127596.628481:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789127596.628496:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789127596.628985:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789127596.629005:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789127596.629019:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789127596.629033:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789127596.629047:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789127596.629061:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789127596.629103:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789127596.629116:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789127596.629128:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789127596.629155:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789127596.629170:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789127596.629182:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789127596.629193:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789127596.629205:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789127596.629217:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789127596.629229:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789127596.629255:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789127596.629273:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789127596.629287:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789127596.629300:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1789127596.629313:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1789127596.629327:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1789127596.629341:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1789127596.629356:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1789127596.629371:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1789127596.629386:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1789127596.629398:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1789127596.629815:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1789127596.629832:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1789127596.629846:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1789127596.629859:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1789127596.629873:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1789127596.629902:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1789127596.629920:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1789127596.629935:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1789127596.629949:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1789127596.629963:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1789127596.629977:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1789127596.629992:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1789127596.630018:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1789127596.630032:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1789127596.630057:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1789127596.630063:0:20271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:2.0:1789127596.630185:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127596.630247:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127596.630282:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517a180 going to sleep for 11 seconds 00000100:00100000:0.0:1789127596.631338:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789595904 00000100:00100000:0.0:1789127596.631349:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789595904 00000100:00100000:0.0:1789127596.631422:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789127596.631431:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:20271:x1876035789595904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789127596.631955:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:20271:x1876035789595904:12345-0@lo:501:mount.lustre.0 Request processed in 524us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127596.631965:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789127596.633757:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789595904:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789127596.633815:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789596032:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127596.633876:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127596.633913:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789596032 00000100:00100000:2.0:1789127596.633919:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789596032 00000100:00100000:2.0:1789127596.633967:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789127596.633976:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:20271:x1876035789596032:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789127596.634074:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:20271:x1876035789596032:12345-0@lo:503:mount.lustre.0 Request processed in 100us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127596.634488:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789127596.634857:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff93468517a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789127596.634876:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789596032:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789127596.638574:0:20271:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789127596.638912:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789596160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127596.638989:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127596.639028:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789596160 00000100:00100000:2.0:1789127596.639034:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789596160 00000100:00100000:2.0:1789127596.639094:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789127596.639106:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:20271:x1876035789596160:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127596.639212:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:20271:x1876035789596160:12345-0@lo:502:mount.lustre.0 Request processed in 109us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127596.639219:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789127596.639267:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127596.639288:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789596160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127596.643222:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789127596.643278:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789127596.643295:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789127596.643309:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789127596.643341:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789127596.643358:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789127596.643370:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789127596.643381:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789127596.643392:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789127596.643403:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789127596.643431:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789127596.643443:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789127596.643456:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789127596.643469:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789127596.643481:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789127596.643493:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789127596.643505:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789127596.643541:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789127596.643555:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789127596.643567:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789127596.643595:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789127596.643611:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789127596.643625:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789127596.643640:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789127596.643655:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1789127596.643679:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1789127596.643695:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1789127596.643708:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1789127596.643720:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1789127596.643735:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1789127596.643748:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1789127596.643763:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1789127596.643775:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1789127596.643788:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1789127596.643803:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1789127596.643817:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1789127596.643842:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1789127596.643855:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1789127596.643866:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1789127596.643876:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1789127596.643889:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1789127596.643904:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1789127596.643918:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1789127596.643933:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1789127596.643948:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789127596.643961:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789127596.643973:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789127596.643987:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789127596.644038:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789596288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127596.646503:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127596.646623:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789596288 00000100:00100000:2.0:1789127596.646631:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789596288 00000100:00100000:2.0:1789127596.646680:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789127596.646690:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:20271:x1876035789596288:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127596.646810:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:20271:x1876035789596288:12345-0@lo:502:mount.lustre.0 Request processed in 121us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127596.646828:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789127596.646884:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3a9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127596.646907:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789596288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127596.649268:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789127596.649324:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789127596.649371:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789596416:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789127596.649450:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127596.649486:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a9c3a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127596.650220:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789596416 00000100:00100000:1.0:1789127596.650229:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789596416 00000100:00100000:1.0:1789127596.650281:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789127596.650291:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:20271:x1876035789596416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789127596.650423:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:20271:x1876035789596416:12345-0@lo:502:mount.lustre.0 Request processed in 133us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127596.650437:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789127596.650633:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789596416:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789127596.650698:0:20271:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789127596.650709:0:20271:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1789127596.654495:0:20283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789127596.654527:0:20283:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9346aeec8000) 00000020:00000080:2.0:1789127596.654553:0:20283:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:2.0:1789127596.654637:0:20283:0:(tgt_mount.c:153:server_get_mount()) get mount ffff934587b44000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789127596.654641:0:20283:0:(tgt_mount.c:187:server_put_mount()) put mount ffff934587b44000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789127596.654644:0:20283:0:(obd_mount.c:710:lustre_put_lsi()) put ffff934587b44000 3 00010000:00080000:2.0:1789127596.654673:0:20283:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9346b9d93000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.148@tcp at head 00010000:00010000:2.0:1789127596.665002:0:20283:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:2.0:1789127596.665462:0:20283:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789127596.665538:0:20283:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789127596.665552:0:20283:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd718aadfd785ea20 00000100:00080000:2.0:1789127596.665561:0:20283:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789127596.665567:0:20283:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9346b9d93000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:2.0:1789127596.665600:0:20283:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9346aed13480 x1876035789596544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789127596.665665:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1876035789596544:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789127596.665745:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127596.665809:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789596544 00000100:00100000:2.0:1789127596.665815:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789596544 00000100:00100000:2.0:1789127596.665841:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127596.665848:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3649:x1876035789596544:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789127596.665868:0:17945:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:2.0:1789127596.665904:0:17945:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd718aadfd785ea27 00000004:00100000:2.0:1789127596.665918:0:17945:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789127596.665949:0:17945:0:(import.c:65:import_set_state_nolock()) ffff934587912800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127596.665995:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed10780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3649:x1876035789596544:12345-0@lo:38:llog_process_th.0 Request processed in 146us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127596.666002:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789127596.666038:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346aed13480 x1876035789596544/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127596.666047:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127596.666054:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789127596.666060:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789127596.666064:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789127596.666066:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346b9d93000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789127596.666072:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3649:1876035789596544:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789127596.669456:0:20283:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:0.0:1789127596.672750:0:20283:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789127596.672767:0:20283:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9346b18f0000) 00000020:00000080:0.0:1789127596.672796:0:20283:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1789127596.672876:0:20283:0:(tgt_mount.c:153:server_get_mount()) get mount ffff934587b44000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789127596.672880:0:20283:0:(tgt_mount.c:187:server_put_mount()) put mount ffff934587b44000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789127596.672883:0:20283:0:(obd_mount.c:710:lustre_put_lsi()) put ffff934587b44000 3 00010000:00080000:0.0:1789127596.672925:0:20283:0:(ldlm_lib.c:102:import_set_conn()) imp ffff934586eba000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.148@tcp at head 00000100:00080000:3.0:1789127596.675807:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127596.675814:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127596.675817:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127596.675820:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789127596.675870:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789127596.675874:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789127596.675878:0:36:0:(import.c:65:import_set_state_nolock()) ffff9346b5489000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789127596.675890:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 552 00000100:00080000:3.0:1789127596.675896:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789127596.675902:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9346b5489000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:3.0:1789127596.675923:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9345878ce940 x1876035789597184/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127596.675986:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789596672:0@lo:400:kworker.0 00000100:00100000:3.0:1789127596.676048:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127596.676714:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789597184:0@lo:8:kworker.0 00000100:00100000:2.0:1789127596.676752:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127596.676807:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789597184 00000100:00100000:2.0:1789127596.676814:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789597184 00000100:00100000:2.0:1789127596.676849:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127596.676856:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3649:x1876035789597184:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789127596.676914:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3649:x1876035789597184:12345-0@lo:8:kworker.0 Request processed in 56us (160us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789127596.676921:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127596.676955:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127596.676962:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346b5489000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789127596.676965:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789127596.676968:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789597184:0@lo:8:kworker.0 00000100:00100000:3.0:1789127596.677499:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789597312:0@lo:400:kworker.0 00000100:00100000:3.0:1789127596.677549:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127596.677576:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127596.677582:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789597056:0@lo:400:kworker.0 00000100:00100000:3.0:1789127596.677607:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127596.677646:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789597312 00000100:00100000:3.0:1789127596.677651:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789597312 00000100:00100000:3.0:1789127596.677702:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789127596.677710:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587896940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789597312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127596.677755:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587896940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789597312:12345-0@lo:400:kworker.0 Request processed in 46us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127596.677763:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1789127596.677793:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345878ce580 x1876035789597312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127596.677805:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789597312:0@lo:400:kworker.0 00000100:00100000:1.0:1789127596.677890:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789596800:0@lo:400:kworker.0 00000100:00100000:1.0:1789127596.677919:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127596.677950:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789597440:0@lo:400:kworker.0 00000100:00100000:1.0:1789127596.677974:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127596.677991:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789127596.677997:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789596928:0@lo:400:kworker.0 00000100:00100000:1.0:1789127596.678017:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127596.678035:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789597568:0@lo:400:kworker.0 00000100:00100000:1.0:1789127596.678057:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127596.678088:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789596800 00000100:00100000:1.0:1789127596.678092:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789596800 00000100:00100000:1.0:1789127596.678111:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789597440 00000100:00100000:1.0:1789127596.678114:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789597440 00000100:00100000:1.0:1789127596.678146:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789597568 00000100:00100000:1.0:1789127596.678149:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789597568 00000100:00100000:1.0:1789127596.678165:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789127596.678171:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789596800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127596.678204:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789596800:12345-0@lo:400:kworker.0 Request processed in 33us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127596.678209:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789127596.678221:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789127596.678227:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789597440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127596.678251:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789597440:12345-0@lo:400:kworker.0 Request processed in 25us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127596.678257:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789127596.678278:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789127596.678283:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ff83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789597568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127596.678313:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ff83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789597568:12345-0@lo:400:kworker.0 Request processed in 30us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127596.678319:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789127596.678337:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789596672 00000100:00100000:1.0:1789127596.678341:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789596672 00000100:00100000:1.0:1789127596.678363:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789596928 00000100:00100000:1.0:1789127596.678366:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789596928 00000100:00100000:1.0:1789127596.678378:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789127596.678385:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587896580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789596672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127596.678431:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587896580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789596672:12345-0@lo:400:kworker.0 Request processed in 47us (2384us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127596.678438:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789127596.678450:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789127596.678455:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789596928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127596.678483:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ffa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789596928:12345-0@lo:400:kworker.0 Request processed in 28us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127596.678489:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789127596.678506:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127596.678532:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127596.678558:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878cd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789596672:0@lo:400:kworker.0 00000100:00100000:1.0:1789127596.678581:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789596928:0@lo:400:kworker.0 00010000:00080000:1.0:1789127596.678591:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345878943c0 x1876035789597568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127596.678599:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878943c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789597568:0@lo:400:kworker.0 00010000:00080000:1.0:1789127596.678618:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345878ccb40 x1876035789596800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127596.678626:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789596800:0@lo:400:kworker.0 00010000:00080000:1.0:1789127596.678635:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587895680 x1876035789597440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127596.678641:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789597440:0@lo:400:kworker.0 00000100:00100000:2.0:1789127596.678859:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789597056 00000100:00100000:2.0:1789127596.678864:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789597056 00000100:00100000:2.0:1789127596.678909:0:19454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789127596.678917:0:19454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789597056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127596.678958:0:19454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789597056:12345-0@lo:400:kworker.0 Request processed in 41us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127596.678964:0:19454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789127596.678996:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9345878ce1c0 x1876035789597056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127596.679004:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789597056:0@lo:400:kworker.0 00010000:00010000:0.0:1789127596.681908:0:20283:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1789127596.682101:0:20283:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000100:00080000:1.0:1789127596.682728:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000010:01000000:0.0:1789127596.685647:0:20283:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789127596.685665:0:20283:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xd718aadfd785ea35 00000100:00080000:0.0:1789127596.685676:0:20283:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789127596.685683:0:20283:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff934586eba000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789127596.685716:0:20283:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ebf480 x1876035789597696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127596.685744:0:20283:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789127596.685772:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127596.685776:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789127596.685779:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127596.685782:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789127596.687360:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3649:1876035789597696:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789127596.687553:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127596.688698:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789597696 00000100:00100000:3.0:1789127596.688709:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789597696 00000100:00100000:3.0:1789127596.688753:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127596.688762:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3649:x1876035789597696:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789127596.688798:0:17946:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 557 last 0 00000020:00000080:3.0:1789127596.688958:0:17946:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xd718aadfd785ea3c 00000004:00100000:3.0:1789127596.688974:0:17946:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789127596.689006:0:17946:0:(import.c:65:import_set_state_nolock()) ffff934587931800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127596.689072:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed10b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3649:x1876035789597696:12345-0@lo:38:llog_process_th.0 Request processed in 310us (1519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127596.689094:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1789127596.689281:0:20283:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:3.0:1789127596.689741:0:20271:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1789127596.689769:0:20271:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789127596.689782:0:20271:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785ea0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ea12 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127596.689793:0:20271:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9345886d7000/0xd718aadfd785ea0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ea12 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789127596.689835:0:20271:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789127596.689838:0:20271:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789127596.689839:0:20271:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127596.689841:0:20271:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127596.689842:0:20271:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127596.689843:0:20271:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127596.689845:0:20271:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127596.689847:0:20271:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127596.689848:0:20271:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127596.689852:0:20271:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1789127596.689854:0:20271:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789127596.689856:0:20271:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789127596.689857:0:20271:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127596.689858:0:20271:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127596.689859:0:20271:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127596.689860:0:20271:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127596.689861:0:20271:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127596.689862:0:20271:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127596.689869:0:20271:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789127596.689889:0:20271:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789127596.689905:0:20271:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587897840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789597824:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789127596.689948:0:20271:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127596.689979:0:20271:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a06aec00 going to sleep for 11 seconds 00010000:00080000:2.0:1789127596.693265:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff934587ebf480 x1876035789597696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789127606 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127596.693281:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789127596.693297:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789127596.693306:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789127596.693311:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789127596.693315:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934586eba000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789127596.693322:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3649:1876035789597696:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789127596.693355:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789597824 00000100:00100000:2.0:1789127596.693361:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789597824 00000100:00100000:2.0:1789127596.693422:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789127596.693431:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:20271:x1876035789597824:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789127596.693458:0:17939:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1789127596.693470:0:17939:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789127596.700483:0:17939:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789127596.700504:0:17939:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1789127596.700791:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:20271:x1876035789597824:12345-0@lo:253:mount.lustre.0 Request processed in 7357us (10838us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127596.700803:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789127596.700865:0:20271:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587897840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:20271:1876035789597824:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789127596.700878:0:20271:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789127596.700881:0:20271:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789127596.700883:0:20271:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789127596.700885:0:20271:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789127596.700886:0:20271:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789127596.700887:0:20271:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789127596.700888:0:20271:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789127596.700890:0:20271:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789127596.700891:0:20271:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789127596.700893:0:20271:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789127596.700904:0:20271:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1789127596.705226:0:17961:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789127596.705237:0:17961:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789127596.705259:0:17961:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.705277:0:17961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff934587fec000/0xd718aadfd785e9b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e9b0 expref: 23 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.705285:0:17961:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff934587fede00/0xd718aadfd785e9c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e9be expref: 23 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.705292:0:17961:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.705330:0:17961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff934587fede00/0xd718aadfd785e9c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785e9be expref: 23 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.705345:0:17961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff934587fede00/0xd718aadfd785e9c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785e9be expref: 23 pid: 17938 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127596.705360:0:17961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17961:1876035789597952:0@lo:104: 00000100:00100000:0.0:1789127596.705430:0:17961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789127596.705487:0:17961:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff934587fec000/0xd718aadfd785e9b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785e9b0 expref: 23 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.705532:0:17961:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff934587fec000/0xd718aadfd785e9b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785e9b0 expref: 23 pid: 17939 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127596.705543:0:17961:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17961:1876035789598080:0@lo:104: 00000100:00100000:0.0:1789127596.705569:0:17961:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127596.705586:0:17961:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b9feab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127596.706090:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789597952 00000100:00100000:0.0:1789127596.706097:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789597952 00000100:00100000:0.0:1789127596.706132:0:17929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789598080 00000100:00100000:0.0:1789127596.706135:0:17929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789598080 00000100:00100000:0.0:1789127596.706149:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127596.706157:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+4:17961:x1876035789597952:12345-0@lo:104: 00010000:00010000:0.0:1789127596.706169:0:17929:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e9c5 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.706223:0:17929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789127596.706229:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+4:17961:x1876035789597952:12345-0@lo:104: Request processed in 73us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127596.706236:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127596.706253:0:17929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127596.706260:0:17929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+3:17961:x1876035789598080:12345-0@lo:104: 00010000:00010000:0.0:1789127596.706268:0:17929:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e9b7 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.706299:0:17929:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789127596.706304:0:17929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+3:17961:x1876035789598080:12345-0@lo:104: Request processed in 46us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127596.706320:0:17929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789127596.706482:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127596.706488:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e9c5 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.706496:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed000 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127596.706500:0:17933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785e9c5 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.706529:0:17933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785e9c5 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127596.706537:0:17933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785e9c5 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127596.706542:0:17933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127596.706571:0:17933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e9c5 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.706578:0:17933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127596.706597:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e9c5 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.706603:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785e9be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e9c5 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.706613:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127596.706616:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e9b7 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.706632:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b000 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:0.0:1789127596.706635:0:17933:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785e9b7 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.706642:0:17933:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785e9b7 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789127596.706647:0:17933:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785e9b7 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127596.706653:0:17933:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789127596.706666:0:17933:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e9b7 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.706672:0:17933:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789127596.706679:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e9b7 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.706685:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff93468501b000/0xd718aadfd785e9b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e9b7 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.706696:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127596.706698:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127596.706699:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127596.706718:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789598208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127596.706748:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127596.706773:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127596.706779:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789598336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127596.706812:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127596.706839:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789598208 00000100:00100000:0.0:1789127596.706843:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789598208 00010000:00010000:0.0:1789127596.706860:0:17931:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff934587fede00/0xd718aadfd785e9c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e9be expref: 24 pid: 17938 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127596.706879:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789598336 00000100:00100000:0.0:1789127596.706882:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789598336 00010000:00010000:0.0:1789127596.706893:0:17931:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff934587fec000/0xd718aadfd785e9b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e9b0 expref: 25 pid: 17939 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127596.706907:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127596.706913:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+25:3650:x1876035789598208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127596.706922:0:17931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127596.706927:0:17931:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff934587fede00/0xd718aadfd785e9c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e9be expref: 25 pid: 17938 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.706937:0:17931:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff934587fede00/0xd718aadfd785e9c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785e9be expref: 25 pid: 17938 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.706951:0:17931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127596.706979:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+25:3650:x1876035789598208:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127596.706986:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789127596.707000:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127596.707007:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:3650:x1876035789598336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127596.707015:0:17931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127596.707018:0:17931:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff934587fec000/0xd718aadfd785e9b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e9b0 expref: 24 pid: 17939 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.707036:0:17931:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff934587fec000/0xd718aadfd785e9b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785e9b0 expref: 24 pid: 17939 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.707048:0:17931:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.707056:0:17931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789127596.707070:0:17931:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013714757s 00010000:00010000:0.0:1789127596.707074:0:17931:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.707081:0:17931:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.707088:0:17931:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.707094:0:17931:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.707099:0:17931:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed400 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127596.707103:0:17931:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.707109:0:17931:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.707117:0:17931:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.707131:0:17931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127596.707155:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebf840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:3650:x1876035789598336:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127596.707162:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127596.707200:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789598336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127596.707210:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789598208:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789127596.707240:0:17961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587fede00/0xd718aadfd785e9c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785e9be expref: 23 pid: 17938 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127596.707250:0:17961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17961:1876035789597952:0@lo:104: 00010000:00010000:0.0:1789127596.707260:0:17961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587fec000/0xd718aadfd785e9b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785e9b0 expref: 22 pid: 17939 timeout: 657 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127596.707267:0:17961:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd2c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17961:1876035789598080:0@lo:104: 00010000:00010000:0.0:1789127596.707280:0:17961:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.707288:0:17961:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.707295:0:17961:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127596.707301:0:17961:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587fed400/0xd718aadfd785ea43 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17961 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127596.708122:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1789127596.724854:0:20271:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1789127596.727202:0:20271:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1789127596.727210:0:20271:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1789127596.727247:0:20271:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789127596.727290:0:20271:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.148@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789127596.727308:0:20271:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1789127596.727326:0:20271:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789127596.735853:0:20271:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127596.736097:0:20271:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789127596.856284:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789598464:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789127596.856391:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127596.856545:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789598464 00000100:00100000:2.0:1789127596.856553:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789598464 00000100:00100000:2.0:1789127596.856597:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789127596.856607:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690402d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789598464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789127596.856638:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789127596.856702:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690402d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789598464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 97us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127596.856710:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789127596.856802:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9346aed12580 x1876035789598464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127596.856820:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789598464:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789127597.048952:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789127597.547342:0:20339:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789127597.548954:0:20339:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789127597.880391:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127597.880485:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789598592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789127597.880579:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127597.880712:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127597.880722:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789598720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127597.880749:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127597.886580:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789598592 00000100:00100000:1.0:1789127597.886593:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789598592 00000100:00100000:1.0:1789127597.886649:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789598720 00000100:00100000:1.0:1789127597.886653:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789598720 00000100:00100000:1.0:1789127597.886672:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789127597.886681:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789598592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127597.886719:0:18689:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789127597.886802:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789598592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (6222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127597.886822:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789127597.886840:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789127597.886846:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789598720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127597.886862:0:18689:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789127597.886980:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed121c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789598720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (6227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127597.886986:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789127597.887033:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed11a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789598720:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127597.887073:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789598592:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1789127598.007590:0:17942:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789127598.007598:0:17942:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9346c1efc000 from 10 10000000:01000000:0.0:1789127598.007603:0:17942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127598.007652:0:17942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785ea4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127598.007663:0:17942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785ea4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127598.007674:0:17942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785ea4a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127598.007700:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789598848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127598.007765:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127598.007816:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d2ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789127598.007884:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789598848 00000100:00100000:3.0:1789127598.007891:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789598848 00000100:00100000:3.0:1789127598.007948:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789127598.007957:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:17942:x1876035789598848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127598.007969:0:17940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127598.007993:0:17940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93468501b200/0xd718aadfd785ea51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785ea4a expref: -99 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127598.008016:0:17940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93468501b200/0xd718aadfd785ea51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785ea4a expref: 23 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127598.008027:0:17940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93468501b200/0xd718aadfd785ea51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785ea4a expref: 23 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127598.008037:0:17940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93468501b200, rc 0) 00000100:00100000:3.0:1789127598.008094:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:17942:x1876035789598848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127598.008101:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789127598.008257:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789598848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127598.008271:0:17942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785ea4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ea51 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127598.008287:0:17942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785ea4a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785ea51 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127598.008350:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed12d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789598976:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789127598.008381:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127598.008414:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934688af3480 going to sleep for 11 seconds 00000100:00100000:3.0:1789127598.008499:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789598976 00000100:00100000:3.0:1789127598.008504:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789598976 00000100:00100000:3.0:1789127598.008564:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789127598.008570:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:17942:x1876035789598976:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789127598.008584:0:17939:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789127598.008599:0:17939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789127598.008602:0:17939:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1789127598.008677:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:17942:x1876035789598976:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127598.008685:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789127598.008832:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed12d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789598976:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789127598.008888:0:17942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789127598.008895:0:17942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785ea4a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ea51 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127598.008903:0:17942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587feda00/0xd718aadfd785ea4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ea51 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127598.008911:0:17942:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789127598.008913:0:17942:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9346b7fe3800 from 10 10000000:01000000:0.0:1789127598.008916:0:17942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789127598.008932:0:17942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785ea58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127598.008948:0:17942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785ea58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127598.008956:0:17942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785ea58 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127598.008969:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789599104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127598.008996:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127598.009016:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d2a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127598.011127:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789599104 00000100:00100000:2.0:1789127598.011141:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789599104 00000100:00100000:2.0:1789127598.011212:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789127598.011222:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:17942:x1876035789599104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127598.011237:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127598.011253:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9345886d7e00/0xd718aadfd785ea5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785ea58 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127598.011280:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9345886d7e00/0xd718aadfd785ea5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785ea58 expref: 24 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127598.011291:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9345886d7e00/0xd718aadfd785ea5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785ea58 expref: 24 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127598.011300:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9345886d7e00, rc 0) 00000100:00100000:2.0:1789127598.011380:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:17942:x1876035789599104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (2382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127598.011387:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789127598.011596:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789599104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127598.011615:0:17942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785ea58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ea5f expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127598.011624:0:17942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785ea58 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785ea5f expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127598.011686:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789599232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789127598.011721:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127598.011746:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d2a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789127598.012694:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789599232 00000100:00100000:2.0:1789127598.012703:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789599232 00000100:00100000:2.0:1789127598.012743:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789127598.012763:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:17942:x1876035789599232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789127598.012782:0:17939:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789127598.012797:0:17939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789127598.012800:0:17939:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789127598.012912:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:17942:x1876035789599232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 150us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127598.012919:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789127598.012999:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789599232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789127598.013059:0:17942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789127598.013067:0:17942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785ea58 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ea5f expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127598.013076:0:17942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fecc00/0xd718aadfd785ea58 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ea5f expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127598.073813:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789127598.648113:0:18702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789127599.095704:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127599.736785:0:3649:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127579/real 1789127579] req@ffff9346b7397c00 x1876035789585024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127599 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127599.736817:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9346b7397c00 x1876035789585024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127599 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127599.736828:0:3649:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789127579/real 1789127579] req@ffff9346b73970c0 x1876035789585152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127599 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127599.736872:0:3649:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9346b73970c0 x1876035789585152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789127599 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789127599.736893:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934587f1c000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127599.737059:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789127599.737184:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789585024:0@lo:8:kworker.0 00000100:00080000:3.0:1789127599.737191:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346bea9b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789127599.737197:0:3649:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789127599.737200:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b73970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789585152:0@lo:8:kworker.0 00000100:00100000:2.0:1789127599.737962:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1789127599.738012:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127599.738017:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789127599.738020:0:36:0:(import.c:65:import_set_state_nolock()) ffff934587f1c000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127599.738025:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 540 00000100:00080000:0.0:1789127599.738031:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789127599.738037:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff934587f1c000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789127599.738058:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ebd2c0 x1876035789599616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789127599.738071:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789127599.738075:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789127599.738076:0:36:0:(import.c:65:import_set_state_nolock()) ffff9346bea9b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127599.738079:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 540 00000100:00080000:0.0:1789127599.738082:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789127599.738085:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9346bea9b000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789127599.738095:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934587ebd680 x1876035789599744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789127599.738165:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789599488:0@lo:400:kworker.0 00000100:00100000:3.0:1789127599.738228:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127599.738263:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789127599.738282:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789599872:0@lo:400:kworker.0 00000100:00100000:3.0:1789127599.738308:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127599.738341:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789599488 00000100:00100000:3.0:1789127599.738348:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789599488 00000100:00100000:3.0:1789127599.738401:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789127599.738410:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587897840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789599488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127599.738458:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587897840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789599488:12345-0@lo:400:kworker.0 Request processed in 49us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127599.738465:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789127599.738487:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789599872 00000100:00100000:3.0:1789127599.738490:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789599872 00000100:00100000:3.0:1789127599.738539:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789127599.738546:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587895a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789599872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127599.738590:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587895a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3652:x1876035789599872:12345-0@lo:400:kworker.0 Request processed in 45us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127599.738596:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789127599.738636:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebe940 x1876035789599872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127599.738647:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3652:1876035789599872:0@lo:400:kworker.0 00000100:00100000:3.0:1789127599.738658:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebe1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789599488:0@lo:400:kworker.0 00000100:00100000:3.0:1789127599.738683:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789599616:0@lo:8:kworker.0 00000100:00100000:3.0:1789127599.738711:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127599.738739:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789599744:0@lo:8:kworker.0 00000100:00100000:1.0:1789127599.739924:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789127599.739944:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692954f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789600000:0@lo:400:kworker.0 00000100:00100000:1.0:1789127599.739992:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127599.740997:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127599.741070:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789599616 00000100:00100000:3.0:1789127599.741078:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789599616 00000100:00100000:3.0:1789127599.741105:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789599744 00000100:00100000:3.0:1789127599.741108:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789599744 00000100:00100000:3.0:1789127599.741124:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127599.741131:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3649:x1876035789599616:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789127599.741160:0:19456:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:3.0:1789127599.741193:0:19456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd718aadfd785ea66 00002000:00100000:3.0:1789127599.741205:0:19456:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff934587936000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113987 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789127599.741209:0:19456:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789127599.741212:0:19456:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789127599.741277:0:19456:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789127599.741300:0:19456:0:(import.c:65:import_set_state_nolock()) ffff934587930000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127599.741344:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587894000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1876035789599616:12345-0@lo:8:kworker.0 Request processed in 213us (2632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127599.741362:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789127599.741378:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789127599.741382:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587896d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3649:x1876035789599744:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789127599.741410:0:19456:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:3.0:1789127599.741424:0:19456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd718aadfd785ea6d 00002000:00100000:3.0:1789127599.741430:0:19456:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff934587932800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113987 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789127599.741433:0:19456:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789127599.741434:0:19456:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789127599.741671:0:19456:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789127599.741686:0:19456:0:(import.c:65:import_set_state_nolock()) ffff934587930800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127599.741719:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587896d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3649:x1876035789599744:12345-0@lo:8:kworker.0 Request processed in 334us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127599.741725:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789127599.741853:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebd2c0 x1876035789599616/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127599.741864:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127599.741872:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789127599.741880:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789127599.741884:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789127599.741887:0:3649:0:(import.c:65:import_set_state_nolock()) ffff934587f1c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789127599.741901:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789127599.741906:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789599616:0@lo:8:kworker.0 00010000:00080000:3.0:1789127599.741919:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587ebd680 x1876035789599744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127599.741926:0:3649:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789127599.741937:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789127599.741942:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789127599.741945:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789127599.741948:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346bea9b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789127599.741969:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789127599.741973:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3649:1876035789599744:0@lo:8:kworker.0 00000100:00100000:2.0:1789127599.742165:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789600000 00000100:00100000:2.0:1789127599.742171:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789600000 00000100:00100000:2.0:1789127599.742205:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789127599.742212:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690402940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789600000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127599.742254:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690402940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789600000:12345-0@lo:400:kworker.0 Request processed in 42us (2261us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127599.742260:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789127599.742282:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789599360:0@lo:400:kworker.0 00000100:00100000:2.0:1789127599.742319:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127599.742343:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789599360 00000100:00100000:2.0:1789127599.742347:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789599360 00000100:00100000:2.0:1789127599.742372:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789127599.742379:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:3650:x1876035789599360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127599.742421:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:3650:x1876035789599360:12345-0@lo:400:kworker.0 Request processed in 42us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127599.742427:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789127599.742468:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ebfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789599360:0@lo:400:kworker.0 00000100:00100000:2.0:1789127599.742480:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789127599.742493:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789600128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127599.742539:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127599.742561:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789600128 00000100:00100000:2.0:1789127599.742565:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789600128 00000100:00100000:2.0:1789127599.742598:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789127599.742605:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789600128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127599.742624:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789127599.742654:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed10f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789600128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127599.742660:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789127599.742675:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789127599.742694:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934587895680 x1876035789600128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127599.742707:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789600128:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1789127599.742738:0:17971:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789127599.742873:0:17969:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789127599.742943:0:17969:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 560935432594ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789127599.742948:0:17969:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789127599.743030:0:17972:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1789127599.743047:0:17972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692955e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17972:1876035789600384:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789127599.743202:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127599.743230:0:17972:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d2af00 going to sleep for 11 seconds 00000004:00080000:3.0:1789127599.743239:0:17970:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00080000:0.0:1789127599.743251:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:3.0:1789127599.743255:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878943c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17970:1876035789600640:0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1789127599.743260:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789127599.743262:0:36:0:(import.c:65:import_set_state_nolock()) ffff9346b5489000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789127599.743382:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9346b5489000 using connection 192.168.206.148@tcp/0@lo 00000100:00100000:0.0:1789127599.743412:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff934692955a40 x1876035789600768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789127599.744147:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789600384 00000100:00100000:1.0:1789127599.744155:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789600384 00000100:00100000:1.0:1789127599.744202:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127599.744211:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17972:x1876035789600384:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789127599.746048:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127599.746081:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b726bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127599.746106:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789600512:0@lo:400:kworker.0 00000100:00100000:3.0:1789127599.746138:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127599.746159:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692954780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789601280:0@lo:400:kworker.0 00000100:00100000:3.0:1789127599.746189:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127599.746215:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789127599.746222:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789600256:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789127599.746245:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127599.746261:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789601152:0@lo:400:kworker.0 00000100:00100000:3.0:1789127599.746280:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127599.746706:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789600640 00000100:00100000:0.0:1789127599.746714:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789600640 00000100:00100000:0.0:1789127599.746747:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789600512 00000100:00100000:0.0:1789127599.746750:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789600512 00000100:00100000:0.0:1789127599.746772:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127599.746779:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789600512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127599.746836:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789600512:12345-0@lo:400:kworker.0 Request processed in 57us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127599.746843:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789127599.746860:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789127599.746865:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587895680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17970:x1876035789600640:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789127599.747087:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692956580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789601024:0@lo:400:kworker.0 00000100:00100000:0.0:1789127599.747121:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127599.747159:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692954f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789600000:0@lo:400:kworker.0 00000100:00100000:0.0:1789127599.747181:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789127599.747187:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692954b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789600896:0@lo:400:kworker.0 00000100:00100000:0.0:1789127599.747210:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127599.747222:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692956d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789601408:0@lo:400:kworker.0 00000100:00100000:0.0:1789127599.747243:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127599.747263:0:3649:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692955a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789600768:0@lo:8:kworker.0 00000100:00100000:0.0:1789127599.747298:0:3649:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127599.747405:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789600256 00000100:00100000:3.0:1789127599.747410:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789600256 00000100:00100000:3.0:1789127599.747444:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127599.747450:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1876035789600256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127599.747470:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000004:00080000:2.0:1789127599.748092:0:17971:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 560940581646ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789127599.748100:0:17971:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00080000:2.0:1789127599.748120:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127599.748125:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127599.748135:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789601280 00000100:00100000:2.0:1789127599.748140:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789601280 00000100:00100000:2.0:1789127599.748172:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789601152 00000100:00100000:2.0:1789127599.748175:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789601152 00000100:00100000:2.0:1789127599.748188:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789601024 00000100:00100000:2.0:1789127599.748191:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789601024 00000100:00100000:2.0:1789127599.748202:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789600896 00000100:00100000:2.0:1789127599.748205:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789600896 00000100:00100000:2.0:1789127599.748214:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789601408 00000100:00100000:2.0:1789127599.748217:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789601408 00000100:00100000:2.0:1789127599.748243:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789127599.748249:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789601280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127599.749543:0:19454:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789127599.749555:0:19454:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789127599.749740:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789600768 00000100:00100000:0.0:1789127599.749747:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789600768 00000100:00100000:0.0:1789127599.749833:0:20454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789127599.749840:0:20454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692920780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:3649:x1876035789600768:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1789127599.749871:0:20454:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 560 last 0 00000020:00000080:0.0:1789127599.749908:0:20454:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xd718aadfd785ea74 00002000:00100000:0.0:1789127599.749922:0:20454:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff934586ebd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113987 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789127599.749926:0:20454:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1789127599.749929:0:20454:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789127599.749987:0:20454:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789127599.750010:0:20454:0:(import.c:65:import_set_state_nolock()) ffff934586ebc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127599.750128:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3653:x1876035789600256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2676us (3879us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127599.750143:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789127599.750175:0:17946:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789127599.750182:0:17946:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:3.0:1789127599.750256:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692957840 x1876035789600256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127599.750275:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789600256:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789127599.750289:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692957c00 x1876035789600512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789127615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127599.750299:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789600512:0@lo:400:kworker.0 00000100:00100000:3.0:1789127599.750346:0:17947:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789127599.750356:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127599.750365:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789601152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127599.750421:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789601152:12345-0@lo:400:kworker.0 Request processed in 58us (4138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127599.750428:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789127599.750443:0:17947:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789127599.750450:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127599.750457:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692922580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789601024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127599.750491:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692922580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789601024:12345-0@lo:400:kworker.0 Request processed in 36us (3370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127599.750497:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789127599.750526:0:17947:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789127599.750533:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127599.750540:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692921e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789600896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127599.750570:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692921e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789600896:12345-0@lo:400:kworker.0 Request processed in 30us (3359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127599.750582:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789127599.750593:0:17947:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789127599.750598:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789127599.750603:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692921680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789601408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127599.750630:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692921680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789601408:12345-0@lo:400:kworker.0 Request processed in 27us (3386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127599.750635:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789127599.750789:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789601280:12345-0@lo:400:kworker.0 Request processed in 2538us (4598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127599.750796:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1789127599.750815:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127599.750819:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789127599.751366:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692954b40 x1876035789600896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127599.751378:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692954b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789600896:0@lo:400:kworker.0 00010000:00080000:3.0:1789127599.751408:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692956d00 x1876035789601408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127599.751417:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692956d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789601408:0@lo:400:kworker.0 00010000:00080000:3.0:1789127599.751430:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692956580 x1876035789601024/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127599.751438:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692956580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789601024:0@lo:400:kworker.0 00000100:00100000:0.0:1789127599.752298:0:20454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692920780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:3649:x1876035789600768:12345-0@lo:8:kworker.0 Request processed in 2455us (4995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127599.752308:0:20454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789127599.752345:0:3649:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692955a40 x1876035789600768/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789127624 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789127599.752360:0:3649:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789127599.752369:0:3649:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789127599.752374:0:3649:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789127599.752377:0:3649:0:(import.c:65:import_set_state_nolock()) ffff9346b5489000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789127599.752547:0:3649:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789127599.752554:0:3649:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692955a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3649:1876035789600768:0@lo:8:kworker.0 00002000:00080000:1.0:1789127599.752656:0:19456:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789127599.752663:0:19456:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789127599.752669:0:19456:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00010000:00080000:2.0:1789127599.753564:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692957480 x1876035789601152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127599.753579:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789601152:0@lo:400:kworker.0 00010000:00080000:2.0:1789127599.753593:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934692954780 x1876035789601280/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127615 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127599.753602:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692954780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789601280:0@lo:400:kworker.0 00000004:00080000:2.0:1789127599.755915:0:18692:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789127599.756017:0:18692:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 560948506842ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789127599.756025:0:18692:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789127599.756541:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346929203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789601536:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789127599.756609:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1789127599.756731:0:18693:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789127599.756770:0:18693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346929212c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18693:1876035789601664:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789127599.756798:0:18693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127599.756816:0:18693:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d2a3c0 going to sleep for 11 seconds 00002000:00080000:0.0:1789127599.756832:0:20028:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1789127599.756839:0:20028:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1789127599.756844:0:20028:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000100:00100000:2.0:1789127599.756918:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789601536 00000100:00100000:2.0:1789127599.756925:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789601536 00000100:00100000:2.0:1789127599.756974:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789127599.756982:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1876035789601536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127599.757001:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789127599.757289:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3651:x1876035789601536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 307us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127599.757297:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789127599.757329:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789127599.757533:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346929203c0 x1876035789601536/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789127615 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127599.757553:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346929203c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789601536:0@lo:13:osp-pre-1-1.0 00002000:00010000:1.0:1789127599.761984:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.761995:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ea7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762114:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1789127599.762119:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.762126:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ea7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762144:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ea7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762154:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ea7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762162:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ea7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762188:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789127599.762574:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.762580:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785ea82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762589:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1789127599.762593:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.762596:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785ea82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762605:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785ea82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762625:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785ea82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762632:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785ea82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762726:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789127599.762737:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127599.762742:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ea7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762749:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c800 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.762752:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ea7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762760:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ea7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762774:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ea7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762781:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ea7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762970:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127599.762981:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785ea82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.762989:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.762992:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785ea82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.763000:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785ea82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.763012:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785ea82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.764301:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785ea82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.764326:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.764328:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.764330:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.765240:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127599.768212:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789601664 00000100:00100000:3.0:1789127599.768234:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789601664 00000100:00100000:3.0:1789127599.768287:0:19454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127599.768296:0:19454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692922940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18693:x1876035789601664:12345-0@lo:7:osp-pre-1-1.0 00002000:00010000:2.0:1789127599.769452:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.769463:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785ea89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.769480:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.769485:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.769492:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785ea89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.769590:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785ea89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789127599.769977:0:18681:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00010000:2.0:1789127599.774757:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785ea89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.774765:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785ea89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.774794:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127599.775040:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127599.775047:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785ea89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.775055:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7400 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.775059:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785ea89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.775080:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785ea89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.775099:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785ea89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.775107:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785ea89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.775128:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.775130:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.775132:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127599.777878:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.777891:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064146077/0xd718aadfd785ea90 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.780956:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.780962:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.780970:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064146077/0xd718aadfd785ea90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.781002:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064146077/0xd718aadfd785ea90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.781016:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064146077/0xd718aadfd785ea90 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.781023:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064146077/0xd718aadfd785ea90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.781047:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127599.782793:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127599.782802:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064146077/0xd718aadfd785ea90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.782815:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.782820:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064146077/0xd718aadfd785ea90 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.782830:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064146077/0xd718aadfd785ea90 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.782849:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064146077/0xd718aadfd785ea90 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.782869:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064146077/0xd718aadfd785ea90 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.782890:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.782893:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.782894:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789127599.783058:0:17925:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1789127599.783162:0:19454:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789127599.783169:0:19454:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789127599.783255:0:19454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692922940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18693:x1876035789601664:12345-0@lo:7:osp-pre-1-1.0 Request processed in 14956us (26451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127599.783265:0:19454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00002000:00010000:1.0:1789127599.783653:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.783660:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ba5684f/0xd718aadfd785ea97 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.783672:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1789127599.783676:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.783682:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ba5684f/0xd718aadfd785ea97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.783696:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ba5684f/0xd718aadfd785ea97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.783706:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ba5684f/0xd718aadfd785ea97 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.783719:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ba5684f/0xd718aadfd785ea97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.783736:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127599.783746:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127599.783757:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ba5684f/0xd718aadfd785ea97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.783764:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858dc00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.783768:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ba5684f/0xd718aadfd785ea97 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.783776:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ba5684f/0xd718aadfd785ea97 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.783789:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ba5684f/0xd718aadfd785ea97 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.783797:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ba5684f/0xd718aadfd785ea97 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.783815:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.783817:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.783820:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127599.783859:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.783868:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000744d3316/0xd718aadfd785ea9e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.783879:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.783884:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.783889:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000744d3316/0xd718aadfd785ea9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.783899:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000744d3316/0xd718aadfd785ea9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.783908:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000744d3316/0xd718aadfd785ea9e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.783926:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000744d3316/0xd718aadfd785ea9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.783947:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127599.783952:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127599.783958:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000744d3316/0xd718aadfd785ea9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.783966:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9117c00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.783969:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000744d3316/0xd718aadfd785ea9e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.783988:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000744d3316/0xd718aadfd785ea9e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.783999:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000744d3316/0xd718aadfd785ea9e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.784006:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000744d3316/0xd718aadfd785ea9e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.784021:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.784023:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.784024:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127599.784361:0:18693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346929212c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18693:1876035789601664:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789127599.784374:0:18693:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1789127599.784429:0:18693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346929212c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18693:1876035789601792:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789127599.784474:0:18693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127599.784499:0:18693:0:(client.c:2715:ptlrpc_set_wait()) set ffff934586d2a3c0 going to sleep for 11 seconds 00002000:00010000:2.0:1789127599.785054:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.785061:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf2431b/0xd718aadfd785eaa5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785072:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.785075:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.785080:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005bf2431b/0xd718aadfd785eaa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785091:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005bf2431b/0xd718aadfd785eaa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785100:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005bf2431b/0xd718aadfd785eaa5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785107:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005bf2431b/0xd718aadfd785eaa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785128:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127599.785550:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.785556:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002574110b/0xd718aadfd785eaac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785572:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.785575:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.785579:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002574110b/0xd718aadfd785eaac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785589:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002574110b/0xd718aadfd785eaac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785597:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002574110b/0xd718aadfd785eaac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785605:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002574110b/0xd718aadfd785eaac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785617:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789127599.785916:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.785922:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eb0d76b/0xd718aadfd785eab3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785930:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.785934:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.785937:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003eb0d76b/0xd718aadfd785eab3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785947:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003eb0d76b/0xd718aadfd785eab3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785966:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003eb0d76b/0xd718aadfd785eab3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785972:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003eb0d76b/0xd718aadfd785eab3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.785980:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789127599.786454:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789127599.786462:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005bf2431b/0xd718aadfd785eaa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786471:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9116400 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.786475:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf2431b/0xd718aadfd785eaa5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786491:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005bf2431b/0xd718aadfd785eaa5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786522:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005bf2431b/0xd718aadfd785eaa5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786541:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005bf2431b/0xd718aadfd785eaa5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786559:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127599.786562:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002574110b/0xd718aadfd785eaac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786568:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9116000 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.786571:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002574110b/0xd718aadfd785eaac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786578:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002574110b/0xd718aadfd785eaac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786589:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002574110b/0xd718aadfd785eaac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786596:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002574110b/0xd718aadfd785eaac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786607:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127599.786610:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003eb0d76b/0xd718aadfd785eab3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786616:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9117e00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.786625:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003eb0d76b/0xd718aadfd785eab3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786633:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003eb0d76b/0xd718aadfd785eab3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786643:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003eb0d76b/0xd718aadfd785eab3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786650:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003eb0d76b/0xd718aadfd785eab3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.786663:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.786665:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.786667:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127599.787221:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127599.787578:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.787586:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078669b81/0xd718aadfd785eaba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787598:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.787602:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.787606:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078669b81/0xd718aadfd785eaba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787618:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078669b81/0xd718aadfd785eaba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787627:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078669b81/0xd718aadfd785eaba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787635:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078669b81/0xd718aadfd785eaba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787662:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127599.787834:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.787840:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001241a09e/0xd718aadfd785eac1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787850:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.787853:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.787857:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001241a09e/0xd718aadfd785eac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787868:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001241a09e/0xd718aadfd785eac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787876:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001241a09e/0xd718aadfd785eac1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787883:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001241a09e/0xd718aadfd785eac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787898:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789127599.787918:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127599.787923:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078669b81/0xd718aadfd785eaba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787930:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9116c00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127599.787941:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078669b81/0xd718aadfd785eaba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787950:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078669b81/0xd718aadfd785eaba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787965:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078669b81/0xd718aadfd785eaba lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787973:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078669b81/0xd718aadfd785eaba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787988:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127599.787991:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001241a09e/0xd718aadfd785eac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.787998:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9116800 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127599.788001:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001241a09e/0xd718aadfd785eac1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.788008:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001241a09e/0xd718aadfd785eac1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.788018:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001241a09e/0xd718aadfd785eac1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.788025:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001241a09e/0xd718aadfd785eac1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.788045:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.788046:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.788048:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.788229:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127599.788760:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.788767:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000674ac28c/0xd718aadfd785eac8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.788777:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.788780:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.788785:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000674ac28c/0xd718aadfd785eac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.788794:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000674ac28c/0xd718aadfd785eac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.788802:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000674ac28c/0xd718aadfd785eac8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.788809:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000674ac28c/0xd718aadfd785eac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.788823:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127599.788830:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127599.788834:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000674ac28c/0xd718aadfd785eac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.788864:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9116a00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127599.788867:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000674ac28c/0xd718aadfd785eac8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.788877:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000674ac28c/0xd718aadfd785eac8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.788890:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000674ac28c/0xd718aadfd785eac8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.788905:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000674ac28c/0xd718aadfd785eac8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.788920:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.788922:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.788923:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127599.789545:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.789552:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785eacf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.789562:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1789127599.789565:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.789569:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785eacf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.789578:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785eacf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.789597:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785eacf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.789605:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785eacf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.789622:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127599.789946:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127599.789952:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785eacf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.789960:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127599.789964:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785eacf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.789972:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785eacf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.789992:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785eacf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.790000:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036725c5a/0xd718aadfd785eacf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.790018:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.790020:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.790022:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127599.791071:0:19455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789601792 00000100:00100000:2.0:1789127599.791082:0:19455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789601792 00000100:00100000:2.0:1789127599.791124:0:19455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789127599.791134:0:19455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692923840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18693:x1876035789601792:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789127599.791163:0:19455:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1789127599.791238:0:19455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692923840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18693:x1876035789601792:12345-0@lo:5:osp-pre-1-1.0 Request processed in 106us (6765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127599.791246:0:19455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789127599.791289:0:18693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346929212c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18693:1876035789601792:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789127599.791301:0:18693:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789127599.791354:0:18693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed12d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18693:1876035789601920:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789127599.791400:0:18693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127599.791423:0:18693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346828a0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789127599.791437:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789601920 00000100:00100000:2.0:1789127599.791440:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789601920 00000100:00100000:2.0:1789127599.791464:0:19454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127599.791479:0:19454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18693:x1876035789601920:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789127599.791505:0:19454:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:1.0:1789127599.792082:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.792090:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ead6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792104:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1789127599.792108:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.792114:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ead6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792128:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ead6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792137:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ead6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792143:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ead6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792170:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127599.792180:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127599.792185:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ead6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792192:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c800 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.792196:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ead6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792204:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ead6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792219:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ead6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792226:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000734eeca4/0xd718aadfd785ead6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792242:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.792244:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.792246:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127599.792421:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.792427:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080d7763a/0xd718aadfd785eadd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792435:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1789127599.792444:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.792448:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080d7763a/0xd718aadfd785eadd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792457:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080d7763a/0xd718aadfd785eadd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792464:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080d7763a/0xd718aadfd785eadd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792470:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080d7763a/0xd718aadfd785eadd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.792482:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127599.794061:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127599.794070:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080d7763a/0xd718aadfd785eadd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.794082:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d000 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127599.794086:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080d7763a/0xd718aadfd785eadd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.794096:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080d7763a/0xd718aadfd785eadd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.794112:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080d7763a/0xd718aadfd785eadd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.794118:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080d7763a/0xd718aadfd785eadd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.794141:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.794143:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.794144:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127599.794801:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.794810:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbaa838d/0xd718aadfd785eae4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.794821:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1789127599.794826:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.794831:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bbaa838d/0xd718aadfd785eae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.794842:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bbaa838d/0xd718aadfd785eae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.794851:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bbaa838d/0xd718aadfd785eae4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.794867:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bbaa838d/0xd718aadfd785eae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.794882:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127599.794892:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127599.794897:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bbaa838d/0xd718aadfd785eae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.794919:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858ca00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.794922:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbaa838d/0xd718aadfd785eae4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.794931:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bbaa838d/0xd718aadfd785eae4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.794944:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bbaa838d/0xd718aadfd785eae4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.794952:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bbaa838d/0xd718aadfd785eae4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.794967:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.794969:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.794970:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127599.795475:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.795489:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f060ffe2/0xd718aadfd785eaeb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.795499:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1789127599.795502:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.795527:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f060ffe2/0xd718aadfd785eaeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.795539:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f060ffe2/0xd718aadfd785eaeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.795548:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f060ffe2/0xd718aadfd785eaeb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.795556:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f060ffe2/0xd718aadfd785eaeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.795580:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127599.795897:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.795906:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f060ffe2/0xd718aadfd785eaeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.795917:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.795921:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f060ffe2/0xd718aadfd785eaeb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.795932:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f060ffe2/0xd718aadfd785eaeb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127599.795941:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.795951:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8b0892e/0xd718aadfd785eaf2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.795952:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f060ffe2/0xd718aadfd785eaeb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.795971:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=560s v=(0 0) 00010000:00010000:3.0:1789127599.795973:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f060ffe2/0xd718aadfd785eaeb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.795986:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.795992:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8b0892e/0xd718aadfd785eaf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.795995:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.795998:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.796001:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.796006:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8b0892e/0xd718aadfd785eaf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.796015:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8b0892e/0xd718aadfd785eaf2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.796022:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8b0892e/0xd718aadfd785eaf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.796038:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789127599.796540:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.796547:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e59e3ad5/0xd718aadfd785eaf9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796556:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1789127599.796559:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.796563:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e59e3ad5/0xd718aadfd785eaf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796572:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e59e3ad5/0xd718aadfd785eaf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796586:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e59e3ad5/0xd718aadfd785eaf9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796592:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e59e3ad5/0xd718aadfd785eaf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796606:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789127599.796614:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127599.796618:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8b0892e/0xd718aadfd785eaf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796624:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9117000 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.796627:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8b0892e/0xd718aadfd785eaf2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796635:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8b0892e/0xd718aadfd785eaf2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796646:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8b0892e/0xd718aadfd785eaf2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796653:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8b0892e/0xd718aadfd785eaf2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796669:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127599.796678:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e59e3ad5/0xd718aadfd785eaf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796684:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858da00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.796687:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e59e3ad5/0xd718aadfd785eaf9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796695:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e59e3ad5/0xd718aadfd785eaf9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796706:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e59e3ad5/0xd718aadfd785eaf9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796712:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e59e3ad5/0xd718aadfd785eaf9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.796725:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.796727:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.796729:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127599.796929:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.796935:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000472192cc/0xd718aadfd785eb00 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.796943:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.796946:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.796950:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000472192cc/0xd718aadfd785eb00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.796959:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000472192cc/0xd718aadfd785eb00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.796966:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000472192cc/0xd718aadfd785eb00 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.796978:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000472192cc/0xd718aadfd785eb00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.796998:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127599.797495:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.797501:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb07 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.797535:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.797538:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.797543:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.797554:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.797562:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb07 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.797569:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.797578:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789127599.797764:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127599.797771:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000472192cc/0xd718aadfd785eb00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.797780:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9117400 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.797791:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000472192cc/0xd718aadfd785eb00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.797814:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000472192cc/0xd718aadfd785eb00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.797831:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000472192cc/0xd718aadfd785eb00 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.797838:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000472192cc/0xd718aadfd785eb00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.797861:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.797864:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.797871:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9117600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.797875:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127599.797878:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127599.797889:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.797890:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005671bb99/0xd718aadfd785eb0e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.797902:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb07 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.797911:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.797931:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.797933:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.797935:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.798040:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127599.798117:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.798123:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20a5179/0xd718aadfd785eb15 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.798131:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1789127599.798135:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.798140:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20a5179/0xd718aadfd785eb15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.798161:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b20a5179/0xd718aadfd785eb15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.798170:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20a5179/0xd718aadfd785eb15 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.798177:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b20a5179/0xd718aadfd785eb15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.798194:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127599.798202:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127599.798206:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b20a5179/0xd718aadfd785eb15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.798214:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d200 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.798217:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20a5179/0xd718aadfd785eb15 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.798224:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20a5179/0xd718aadfd785eb15 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.798234:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b20a5179/0xd718aadfd785eb15 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.798241:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b20a5179/0xd718aadfd785eb15 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.798262:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.798264:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.798265:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.798399:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.798402:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.798406:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005671bb99/0xd718aadfd785eb0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.798416:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005671bb99/0xd718aadfd785eb0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.798424:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005671bb99/0xd718aadfd785eb0e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.798431:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005671bb99/0xd718aadfd785eb0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.798447:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127599.798456:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127599.798460:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005671bb99/0xd718aadfd785eb0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.798467:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9117200 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127599.798470:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005671bb99/0xd718aadfd785eb0e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.798478:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005671bb99/0xd718aadfd785eb0e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.798502:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005671bb99/0xd718aadfd785eb0e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.798539:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005671bb99/0xd718aadfd785eb0e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.798553:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.798555:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.798556:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127599.800869:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.800880:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e881ef81/0xd718aadfd785eb1c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.800894:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.800897:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00002000:00010000:1.0:1789127599.801291:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.801298:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064146077/0xd718aadfd785eb23 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.801399:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e881ef81/0xd718aadfd785eb1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.801415:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e881ef81/0xd718aadfd785eb1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.801425:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e881ef81/0xd718aadfd785eb1c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.801433:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e881ef81/0xd718aadfd785eb1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.801471:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127599.801559:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.801566:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e881ef81/0xd718aadfd785eb1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.801577:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9116e00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.801581:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e881ef81/0xd718aadfd785eb1c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.801590:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e881ef81/0xd718aadfd785eb1c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.801608:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e881ef81/0xd718aadfd785eb1c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.801615:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e881ef81/0xd718aadfd785eb1c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.801635:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.801649:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.801653:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.801857:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1789127599.801863:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.801867:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000064146077/0xd718aadfd785eb23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.801877:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000064146077/0xd718aadfd785eb23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.801885:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000064146077/0xd718aadfd785eb23 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.801891:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000064146077/0xd718aadfd785eb23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.802087:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:1.0:1789127599.802205:0:17925:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1789127599.802659:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127599.802666:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000064146077/0xd718aadfd785eb23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.802676:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127599.802679:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000064146077/0xd718aadfd785eb23 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.802688:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000064146077/0xd718aadfd785eb23 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.802706:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000064146077/0xd718aadfd785eb23 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.802713:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000064146077/0xd718aadfd785eb23 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.802730:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.802732:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.802733:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127599.802874:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.802880:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785eb2a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127599.803148:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.803154:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f705e62f/0xd718aadfd785eb31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.803162:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.803171:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.803177:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f705e62f/0xd718aadfd785eb31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.803188:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f705e62f/0xd718aadfd785eb31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.803197:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f705e62f/0xd718aadfd785eb31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.803203:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f705e62f/0xd718aadfd785eb31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.803225:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127599.803377:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1789127599.803382:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.803399:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785eb2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.803412:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785eb2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.803422:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785eb2a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.803430:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785eb2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.803448:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789127599.803618:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789127599.803625:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f705e62f/0xd718aadfd785eb31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.803633:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9116600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127599.803636:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f705e62f/0xd718aadfd785eb31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.803645:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f705e62f/0xd718aadfd785eb31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.803666:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f705e62f/0xd718aadfd785eb31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.803673:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f705e62f/0xd718aadfd785eb31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.803690:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127599.803694:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785eb2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.803701:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7400 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127599.803704:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785eb2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.803712:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785eb2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.803723:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785eb2a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.803730:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccb396f9/0xd718aadfd785eb2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.803741:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127599.803743:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127599.803750:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.806200:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127599.806694:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.806703:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f060ffe2/0xd718aadfd785eb38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.806718:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=560s v=(0 0) 00010000:00010000:1.0:1789127599.806723:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.806728:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f060ffe2/0xd718aadfd785eb38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.806743:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f060ffe2/0xd718aadfd785eb38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.806767:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f060ffe2/0xd718aadfd785eb38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.806774:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f060ffe2/0xd718aadfd785eb38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.806787:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127599.807186:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.807193:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086a96cd5/0xd718aadfd785eb3f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.807201:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=560s v=(0 0) 00010000:00010000:2.0:1789127599.807205:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.807208:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086a96cd5/0xd718aadfd785eb3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.807218:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086a96cd5/0xd718aadfd785eb3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.807225:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086a96cd5/0xd718aadfd785eb3f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.807239:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086a96cd5/0xd718aadfd785eb3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.807257:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789127599.807441:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127599.807448:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f060ffe2/0xd718aadfd785eb38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.807470:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.807474:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f060ffe2/0xd718aadfd785eb38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.807485:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f060ffe2/0xd718aadfd785eb38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.807503:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f060ffe2/0xd718aadfd785eb38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.807528:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f060ffe2/0xd718aadfd785eb38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.807550:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.807553:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086a96cd5/0xd718aadfd785eb3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.807560:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9116200 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.807564:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086a96cd5/0xd718aadfd785eb3f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.807572:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086a96cd5/0xd718aadfd785eb3f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.807582:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086a96cd5/0xd718aadfd785eb3f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.807595:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086a96cd5/0xd718aadfd785eb3f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.807609:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.807611:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.807613:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127599.808053:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127599.808059:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785eb46 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.808069:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=560s v=(0 0) 00010000:00010000:3.0:1789127599.808073:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127599.808077:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785eb46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.808086:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785eb46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.808093:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785eb46 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.808100:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785eb46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.808119:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127599.808171:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127599.808178:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785eb46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.808186:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501ac00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127599.808190:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785eb46 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.808197:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785eb46 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.808210:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785eb46 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.808218:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000360115dc/0xd718aadfd785eb46 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.808235:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.808237:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.808238:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127599.808609:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127599.808622:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4f06ad9/0xd718aadfd785eb4d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.808631:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1789127599.808634:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127599.808715:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f06ad9/0xd718aadfd785eb4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.808729:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4f06ad9/0xd718aadfd785eb4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.808737:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4f06ad9/0xd718aadfd785eb4d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.808744:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4f06ad9/0xd718aadfd785eb4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.808760:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127599.808818:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127599.808831:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4f06ad9/0xd718aadfd785eb4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.808838:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b000 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127599.808842:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4f06ad9/0xd718aadfd785eb4d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.808850:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4f06ad9/0xd718aadfd785eb4d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.808861:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4f06ad9/0xd718aadfd785eb4d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.808869:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4f06ad9/0xd718aadfd785eb4d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.808888:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.808889:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.808891:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127599.809204:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127599.809211:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000488bb0a8/0xd718aadfd785eb54 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.809220:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1789127599.809223:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127599.809228:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000488bb0a8/0xd718aadfd785eb54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.809237:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000488bb0a8/0xd718aadfd785eb54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.809254:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000488bb0a8/0xd718aadfd785eb54 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.809262:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000488bb0a8/0xd718aadfd785eb54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.809283:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127599.809330:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127599.809336:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000488bb0a8/0xd718aadfd785eb54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.809344:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501a200 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127599.809347:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000488bb0a8/0xd718aadfd785eb54 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.809366:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000488bb0a8/0xd718aadfd785eb54 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.809378:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000488bb0a8/0xd718aadfd785eb54 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.809385:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000488bb0a8/0xd718aadfd785eb54 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.809488:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.809491:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.809492:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127599.810428:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127599.810436:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac190289/0xd718aadfd785eb5b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.810447:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1789127599.810451:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127599.810457:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac190289/0xd718aadfd785eb5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.810468:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac190289/0xd718aadfd785eb5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.810476:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac190289/0xd718aadfd785eb5b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.810483:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac190289/0xd718aadfd785eb5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.810531:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127599.810560:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127599.810567:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac190289/0xd718aadfd785eb5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.810575:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501a000 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127599.810579:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac190289/0xd718aadfd785eb5b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.810587:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac190289/0xd718aadfd785eb5b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.810602:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac190289/0xd718aadfd785eb5b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.810624:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac190289/0xd718aadfd785eb5b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.810641:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.810644:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.810645:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127599.810929:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127599.810936:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd345853/0xd718aadfd785eb62 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.810945:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1789127599.810948:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127599.810953:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd345853/0xd718aadfd785eb62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.810962:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd345853/0xd718aadfd785eb62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.810971:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd345853/0xd718aadfd785eb62 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.810977:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd345853/0xd718aadfd785eb62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.811003:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127599.811267:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127599.811274:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd345853/0xd718aadfd785eb62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.811283:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501a400 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127599.811286:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd345853/0xd718aadfd785eb62 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.811296:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd345853/0xd718aadfd785eb62 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.811320:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd345853/0xd718aadfd785eb62 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.811328:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd345853/0xd718aadfd785eb62 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.811344:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127599.811346:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127599.811347:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.811530:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127599.811814:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.811821:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3449512/0xd718aadfd785eb69 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.811831:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=561s v=(0 0) 00010000:00010000:2.0:1789127599.811835:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.811840:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3449512/0xd718aadfd785eb69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.811851:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3449512/0xd718aadfd785eb69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.811860:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3449512/0xd718aadfd785eb69 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.811867:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3449512/0xd718aadfd785eb69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.811887:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127599.812124:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.812131:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3449512/0xd718aadfd785eb69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.812139:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9117a00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.812149:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3449512/0xd718aadfd785eb69 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.812162:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3449512/0xd718aadfd785eb69 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.812175:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3449512/0xd718aadfd785eb69 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.812183:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3449512/0xd718aadfd785eb69 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.812201:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.812204:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.812206:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127599.812210:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.812216:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001310f211/0xd718aadfd785eb70 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.812224:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=561s v=(0 0) 00010000:00010000:2.0:1789127599.812227:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.812231:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001310f211/0xd718aadfd785eb70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.812240:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001310f211/0xd718aadfd785eb70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.812249:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001310f211/0xd718aadfd785eb70 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.812255:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001310f211/0xd718aadfd785eb70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.812276:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127599.812637:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.812643:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb77 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.812651:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=561s v=(0 0) 00010000:00010000:2.0:1789127599.812654:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.812658:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.812678:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.812686:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb77 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.812693:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.812708:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789127599.812717:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789127599.812721:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001310f211/0xd718aadfd785eb70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.812728:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9117800 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127599.812731:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001310f211/0xd718aadfd785eb70 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.812740:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001310f211/0xd718aadfd785eb70 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.812743:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127599.812755:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001310f211/0xd718aadfd785eb70 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.812763:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001310f211/0xd718aadfd785eb70 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.812785:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.812788:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.812791:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127599.813048:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.813054:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000472192cc/0xd718aadfd785eb7e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.813062:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=561s v=(0 0) 00010000:00010000:2.0:1789127599.813065:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.813069:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000472192cc/0xd718aadfd785eb7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.813078:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000472192cc/0xd718aadfd785eb7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.813085:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000472192cc/0xd718aadfd785eb7e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.813092:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000472192cc/0xd718aadfd785eb7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.813113:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127599.813134:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.813141:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000472192cc/0xd718aadfd785eb7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.813150:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9117400 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.813153:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000472192cc/0xd718aadfd785eb7e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.813163:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000472192cc/0xd718aadfd785eb7e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.813175:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000472192cc/0xd718aadfd785eb7e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.813191:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000472192cc/0xd718aadfd785eb7e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.813206:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.813208:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.813209:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127599.813910:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.813918:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000744d3316/0xd718aadfd785eb85 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.813940:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=561s v=(0 0) 00010000:00010000:2.0:1789127599.813944:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.813949:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000744d3316/0xd718aadfd785eb85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.813959:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000744d3316/0xd718aadfd785eb85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.813968:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000744d3316/0xd718aadfd785eb85 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.813976:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000744d3316/0xd718aadfd785eb85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.813995:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127599.815647:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.815657:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000523ef8bb/0xd718aadfd785eb8c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.815670:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=561s v=(0 0) 00010000:00010000:2.0:1789127599.815674:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.815680:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000523ef8bb/0xd718aadfd785eb8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.815692:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000523ef8bb/0xd718aadfd785eb8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.815717:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000523ef8bb/0xd718aadfd785eb8c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.815723:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000523ef8bb/0xd718aadfd785eb8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.815733:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789127599.817614:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789127599.817625:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000744d3316/0xd718aadfd785eb85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.817651:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9117c00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.817656:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000744d3316/0xd718aadfd785eb85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.817668:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000744d3316/0xd718aadfd785eb85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.817690:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000744d3316/0xd718aadfd785eb85 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.817698:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000744d3316/0xd718aadfd785eb85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.817724:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.817729:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000523ef8bb/0xd718aadfd785eb8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.817743:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b622c800 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.817747:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000523ef8bb/0xd718aadfd785eb8c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.817757:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000523ef8bb/0xd718aadfd785eb8c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.817769:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000523ef8bb/0xd718aadfd785eb8c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.817776:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000523ef8bb/0xd718aadfd785eb8c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.817791:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.817903:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.817908:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.817967:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.818501:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.818541:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b9117600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.818544:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb77 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.818552:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb77 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.818573:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb77 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.818579:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3cb8d27/0xd718aadfd785eb77 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.818596:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.818598:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.818600:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.818606:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.818608:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789127599.820304:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127599.820315:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bcad88/0xd718aadfd785eb93 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.820329:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=561s v=(0 0) 00010000:00010000:3.0:1789127599.820334:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127599.820339:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011bcad88/0xd718aadfd785eb93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.820351:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011bcad88/0xd718aadfd785eb93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.820359:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011bcad88/0xd718aadfd785eb93 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.820378:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011bcad88/0xd718aadfd785eb93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.820405:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127599.820417:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.820422:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011bcad88/0xd718aadfd785eb93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.820429:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214c400 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.820433:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bcad88/0xd718aadfd785eb93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.820441:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011bcad88/0xd718aadfd785eb93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.820456:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011bcad88/0xd718aadfd785eb93 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.820480:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011bcad88/0xd718aadfd785eb93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.820544:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.820546:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.820550:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127599.820620:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.820628:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ba5684f/0xd718aadfd785eb9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.820638:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1789127599.820641:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.820645:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ba5684f/0xd718aadfd785eb9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.820658:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ba5684f/0xd718aadfd785eb9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.820666:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ba5684f/0xd718aadfd785eb9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.820674:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ba5684f/0xd718aadfd785eb9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.820704:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127599.821237:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.821243:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ba5684f/0xd718aadfd785eb9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.821260:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858dc00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.821264:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ba5684f/0xd718aadfd785eb9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.821273:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ba5684f/0xd718aadfd785eb9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.821286:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ba5684f/0xd718aadfd785eb9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.821294:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ba5684f/0xd718aadfd785eb9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.821313:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.821314:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.821316:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789127599.821790:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.821798:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20a5179/0xd718aadfd785eba1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.821809:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1789127599.821812:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.821817:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20a5179/0xd718aadfd785eba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.821828:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b20a5179/0xd718aadfd785eba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.821837:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20a5179/0xd718aadfd785eba1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.821845:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b20a5179/0xd718aadfd785eba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.821860:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127599.823382:0:20456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.823404:0:20456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b20a5179/0xd718aadfd785eba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789127599.823416:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789127599.823417:0:20456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d200 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.823424:0:20456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20a5179/0xd718aadfd785eba1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.823427:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785eba8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.823448:0:20456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20a5179/0xd718aadfd785eba1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.823450:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1789127599.823462:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.823471:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785eba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.823484:0:20456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b20a5179/0xd718aadfd785eba1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.823486:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785eba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.823535:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785eba8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.823536:0:20456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b20a5179/0xd718aadfd785eba1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.823555:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785eba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.823569:0:20456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.823574:0:20456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785eba8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.823580:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789127599.823587:0:20456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858da00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.823592:0:20456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785eba8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.823599:0:20456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785eba8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.823610:0:20456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785eba8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.823618:0:20456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e59e3ad5/0xd718aadfd785eba8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.823647:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.823654:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.823662:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.823664:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789127599.824065:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.824071:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c98a1a2/0xd718aadfd785ebaf lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.824082:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=561s v=(0 0) 00010000:00010000:2.0:1789127599.824085:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.824090:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c98a1a2/0xd718aadfd785ebaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.824100:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c98a1a2/0xd718aadfd785ebaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.824108:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c98a1a2/0xd718aadfd785ebaf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.824116:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c98a1a2/0xd718aadfd785ebaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.824141:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127599.824254:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.824260:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c98a1a2/0xd718aadfd785ebaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.824268:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b622ca00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.824271:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c98a1a2/0xd718aadfd785ebaf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.824279:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c98a1a2/0xd718aadfd785ebaf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.824290:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c98a1a2/0xd718aadfd785ebaf lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.824298:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c98a1a2/0xd718aadfd785ebaf lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.824313:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.824314:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.824316:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789127599.824739:0:20272:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:0.0:1789127599.824771:0:20272:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789127599.824775:0:20272:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789127599.825008:0:19454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed11a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:18693:x1876035789601920:12345-0@lo:5:osp-pre-1-1.0 Request processed in 33528us (33619us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789127599.825036:0:19454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00002000:00010000:0.0:1789127599.825103:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127599.825110:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045e8771f/0xd718aadfd785ebb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.825137:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1789127599.825140:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127599.825145:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045e8771f/0xd718aadfd785ebb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.825157:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045e8771f/0xd718aadfd785ebb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.825166:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045e8771f/0xd718aadfd785ebb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.825174:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045e8771f/0xd718aadfd785ebb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.825193:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127599.825217:0:17933:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.825225:0:17933:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045e8771f/0xd718aadfd785ebb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.825245:0:17933:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed400 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.825248:0:17933:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045e8771f/0xd718aadfd785ebb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.825257:0:17933:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045e8771f/0xd718aadfd785ebb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.825272:0:17933:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045e8771f/0xd718aadfd785ebb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.825279:0:17933:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045e8771f/0xd718aadfd785ebb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.825294:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.825296:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.825297:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127599.825750:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127599.825757:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000df57b76/0xd718aadfd785ebbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.825765:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1789127599.825769:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127599.825773:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000df57b76/0xd718aadfd785ebbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.825783:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000df57b76/0xd718aadfd785ebbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.825802:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000df57b76/0xd718aadfd785ebbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.825810:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000df57b76/0xd718aadfd785ebbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.825829:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127599.825884:0:20456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.825891:0:20456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000df57b76/0xd718aadfd785ebbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.825899:0:20456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed200 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.825902:0:20456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000df57b76/0xd718aadfd785ebbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.825912:0:20456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000df57b76/0xd718aadfd785ebbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.825930:0:20456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000df57b76/0xd718aadfd785ebbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.825937:0:20456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000df57b76/0xd718aadfd785ebbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.825950:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.825952:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.825954:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127599.826049:0:18693:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789127599.826058:0:18693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed12d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18693:1876035789601920:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789127599.826073:0:18693:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1789127599.826117:0:18693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed12d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:18693:1876035789602048:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1789127599.826159:0:18693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127599.826190:0:18693:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b6477180 going to sleep for 11 seconds 00000100:00100000:3.0:1789127599.826209:0:17957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789602048 00000100:00100000:3.0:1789127599.826216:0:17957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789602048 00002000:00010000:2.0:1789127599.826241:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.826248:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e09173c/0xd718aadfd785ebc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127599.826257:0:17957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789127599.826260:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=561s v=(0 0) 00000100:00100000:3.0:1789127599.826269:0:17957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18693:x1876035789602048:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1789127599.826326:0:17957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed13c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18693:x1876035789602048:12345-0@lo:900:osp-pre-1-1.0 Request processed in 60us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127599.826334:0:17957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789127599.826574:0:18693:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346aed12d00 x1876035789602048/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789127615 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127599.826586:0:18693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed12d00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:18693:1876035789602048:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1789127599.826917:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.826927:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e09173c/0xd718aadfd785ebc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.826941:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e09173c/0xd718aadfd785ebc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.826950:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e09173c/0xd718aadfd785ebc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.826957:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e09173c/0xd718aadfd785ebc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.826990:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789127599.827038:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789127599.827045:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e09173c/0xd718aadfd785ebc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.827055:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b622d000 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:3.0:1789127599.827058:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e09173c/0xd718aadfd785ebc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.827075:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e09173c/0xd718aadfd785ebc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.827089:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e09173c/0xd718aadfd785ebc4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.827097:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e09173c/0xd718aadfd785ebc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127599.827116:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.827118:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.827119:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127599.829076:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127599.829090:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785ebcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.829105:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1789127599.829110:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127599.829116:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785ebcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.829128:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785ebcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.829137:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785ebcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.829145:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785ebcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.829187:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789127599.829776:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.829784:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006235b018/0xd718aadfd785ebd2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.829794:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=561s v=(0 0) 00010000:00010000:2.0:1789127599.829798:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.829802:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006235b018/0xd718aadfd785ebd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.829813:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006235b018/0xd718aadfd785ebd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.829821:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006235b018/0xd718aadfd785ebd2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.829829:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006235b018/0xd718aadfd785ebd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.829847:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789127599.830555:0:20028:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789127599.830563:0:20028:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61b7bdd/0xd718aadfd785ebd9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.830574:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=561s v=(0 0) 00010000:00010000:2.0:1789127599.830585:0:20028:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127599.830591:0:20028:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a61b7bdd/0xd718aadfd785ebd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.830601:0:20028:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a61b7bdd/0xd718aadfd785ebd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.830609:0:20028:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a61b7bdd/0xd718aadfd785ebd9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.830616:0:20028:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a61b7bdd/0xd718aadfd785ebd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.830631:0:20028:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00080000:2.0:1789127599.830669:0:20028:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1789127599.830753:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587895680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17970:x1876035789600640:12345-0@lo:5:osp-pre-0-0.0 Request processed in 83885us (84705us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127599.830764:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789127599.830819:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878943c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17970:1876035789600640:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789127599.830834:0:17970:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:2.0:1789127599.830877:0:17970:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed12580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17970:1876035789602176:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1789127599.831011:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789127599.831019:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785ebcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831027:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec000 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.831031:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785ebcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831041:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785ebcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831063:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785ebcb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831083:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f0be578/0xd718aadfd785ebcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831103:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127599.831107:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006235b018/0xd718aadfd785ebd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831113:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b622d400 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.831117:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006235b018/0xd718aadfd785ebd2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831125:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006235b018/0xd718aadfd785ebd2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831135:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006235b018/0xd718aadfd785ebd2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831141:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006235b018/0xd718aadfd785ebd2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831154:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127599.831156:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a61b7bdd/0xd718aadfd785ebd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831162:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b622d600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.831171:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61b7bdd/0xd718aadfd785ebd9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831179:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a61b7bdd/0xd718aadfd785ebd9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831188:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a61b7bdd/0xd718aadfd785ebd9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831194:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a61b7bdd/0xd718aadfd785ebd9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 20028 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.831207:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.831209:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.831210:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127599.831256:0:17970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127599.831281:0:17970:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346aece5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789127599.831298:0:19455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789602176 00000100:00100000:2.0:1789127599.831302:0:19455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789602176 00000100:00100000:2.0:1789127599.831355:0:19455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127599.831363:0:19455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17970:x1876035789602176:12345-0@lo:5:osp-pre-0-0.0 00010000:00010000:0.0:1789127599.831525:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127599.831580:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127599.831587:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c7f01b/0xd718aadfd785ebe0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.831598:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1789127599.831601:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127599.831605:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c7f01b/0xd718aadfd785ebe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.831615:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1c7f01b/0xd718aadfd785ebe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.831623:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c1c7f01b/0xd718aadfd785ebe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.831630:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c1c7f01b/0xd718aadfd785ebe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.831641:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789127599.832054:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127599.832059:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c1c7f01b/0xd718aadfd785ebe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.832067:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fede00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127599.832071:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c7f01b/0xd718aadfd785ebe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.832079:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c1c7f01b/0xd718aadfd785ebe0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.832090:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c1c7f01b/0xd718aadfd785ebe0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.832104:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1c7f01b/0xd718aadfd785ebe0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.832120:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.832122:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127599.832124:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789127599.832189:0:19455:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00002000:00010000:1.0:1789127599.832894:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789127599.832910:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbaa838d/0xd718aadfd785ebe7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.832921:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=561s v=(0 0) 00010000:00010000:1.0:1789127599.832924:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127599.832929:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bbaa838d/0xd718aadfd785ebe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.832939:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bbaa838d/0xd718aadfd785ebe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.832947:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bbaa838d/0xd718aadfd785ebe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.832953:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bbaa838d/0xd718aadfd785ebe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127599.832973:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789127599.833190:0:20456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127599.833195:0:20456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bbaa838d/0xd718aadfd785ebe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.833203:0:20456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858ca00 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127599.833213:0:20456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbaa838d/0xd718aadfd785ebe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.833223:0:20456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bbaa838d/0xd718aadfd785ebe7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.833236:0:20456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bbaa838d/0xd718aadfd785ebe7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.833244:0:20456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bbaa838d/0xd718aadfd785ebe7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.833259:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127599.833261:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127599.833263:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789127599.833689:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127599.834035:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127599.834042:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b68e0856/0xd718aadfd785ebee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.834053:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1789127599.834056:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127599.834061:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b68e0856/0xd718aadfd785ebee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.834072:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b68e0856/0xd718aadfd785ebee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.834080:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b68e0856/0xd718aadfd785ebee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.834093:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b68e0856/0xd718aadfd785ebee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.834105:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789127599.834353:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789127599.834359:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b68e0856/0xd718aadfd785ebee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.834366:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fed000 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:2.0:1789127599.834369:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b68e0856/0xd718aadfd785ebee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.834377:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b68e0856/0xd718aadfd785ebee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.834399:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b68e0856/0xd718aadfd785ebee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.834406:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b68e0856/0xd718aadfd785ebee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127599.834420:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.834422:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127599.834423:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789127599.834847:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789127599.834852:0:19456:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b475a5d/0xd718aadfd785ebf5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.834862:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=561s v=(0 0) 00010000:00010000:0.0:1789127599.834866:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127599.834870:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b475a5d/0xd718aadfd785ebf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.834880:0:19456:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b475a5d/0xd718aadfd785ebf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.834888:0:19456:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b475a5d/0xd718aadfd785ebf5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.834895:0:19456:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b475a5d/0xd718aadfd785ebf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.834924:0:19456:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1789127599.834972:0:19456:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1789127599.835061:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929543c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17972:x1876035789600384:12345-0@lo:5:osp-pre-1-0.0 Request processed in 90848us (91855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127599.835078:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789127599.835134:0:17972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692955e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17972:1876035789600384:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789127599.835148:0:17972:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1789127599.835192:0:17972:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17972:1876035789602304:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789127599.835227:0:17972:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127599.835258:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789602304 00000100:00100000:0.0:1789127599.835259:0:17972:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346900cee40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127599.835266:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789602304 00010000:00010000:0.0:1789127599.835275:0:20456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789127599.835281:0:20456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b475a5d/0xd718aadfd785ebf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.835290:0:20456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff934587fec600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:0.0:1789127599.835293:0:20456:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b475a5d/0xd718aadfd785ebf5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.835302:0:20456:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b475a5d/0xd718aadfd785ebf5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127599.835306:0:19454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789127599.835316:0:19454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692920f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17972:x1876035789602304:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789127599.835349:0:19454:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:0.0:1789127599.836055:0:20456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b475a5d/0xd718aadfd785ebf5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.836062:0:20456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b475a5d/0xd718aadfd785ebf5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127599.836080:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127599.836082:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789127599.836090:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127599.849105:0:19454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692920f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17972:x1876035789602304:12345-0@lo:5:osp-pre-1-0.0 Request processed in 13783us (13870us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789127599.849123:0:19454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789127599.849189:0:17972:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17972:1876035789602304:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789127599.849203:0:17972:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000001:00080000:2.0:1789127599.856238:0:19451:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1789127599.856299:0:19451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789127599.856574:0:19455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed103c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17970:x1876035789602176:12345-0@lo:5:osp-pre-0-0.0 Request processed in 25207us (25313us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789127599.856586:0:19455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127599.857006:0:17970:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789127599.857015:0:17970:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed12580 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17970:1876035789602176:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789127599.857028:0:17970:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1789127600.122853:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789127601.143641:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127601.976673:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b7397c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789602432:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127601.976734:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127601.976861:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789602432 00000100:00100000:3.0:1789127601.976868:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789602432 00000100:00100000:3.0:1789127601.976921:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789127601.976930:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789602432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127601.976955:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127601.976992:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692923480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789602432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 64us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127601.977007:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789127601.977053:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127601.977083:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b7397c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789602432:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789127602.167743:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789127602.658661:0:20632:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg648-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789127603.004842:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789602560:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789127603.004907:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127603.004975:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789602560 00000100:00100000:1.0:1789127603.004981:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789602560 00000100:00100000:1.0:1789127603.005020:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789127603.005027:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690403840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789602560:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127603.005056:0:17951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789127603.005094:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690403840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789602560:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127603.005100:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789127603.005141:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789602560:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127603.007657:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789127603.007691:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692923c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789602688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127603.007788:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127603.008505:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789602688 00000100:00100000:0.0:1789127603.008543:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789602688 00000100:00100000:0.0:1789127603.008593:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789127603.008603:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7397840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789602688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789127603.008639:0:18689:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789127603.009662:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7397840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789602688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1055us (1868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127603.009674:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789127603.009701:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692923c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789602688:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789127603.192090:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789127603.729824:0:20684:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789127603.730348:0:20684:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789127604.217204:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789127604.703945:0:20734:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789127604.704439:0:20734:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789127604.979720:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127604.979836:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771686656 00000100:00100000:0.0:1789127604.979846:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771686656 00000100:00100000:0.0:1789127604.979895:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:0.0:1789127604.979904:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2398:x1876035771686656:12345-192.168.206.48@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789127604.979933:0:17938:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 284dec05-5462-486c-a9c6-26bee181b930@192.168.206.48@tcp t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:0.0:1789127604.979965:0:17938:0:(genops.c:1385:class_connect()) connect: client 284dec05-5462-486c-a9c6-26bee181b930, cookie 0xd718aadfd785ebfc 00000100:00080000:0.0:1789127604.980105:0:17938:0:(import.c:65:import_set_state_nolock()) ffff9346b9d91800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127604.980190:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+5:2398:x1876035771686656:12345-192.168.206.48@tcp:250:mount.lustre.0 Request processed in 285us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127604.980200:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 113 00000100:00100000:3.0:1789127604.987843:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127604.988427:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771686784 00000100:00100000:2.0:1789127604.988440:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771686784 00000100:00100000:2.0:1789127604.988561:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:2.0:1789127604.988572:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+5:15187:x1876035771686784:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789127604.988587:0:17939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127604.988605:0:17939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346b622c200/0xd718aadfd785ec03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6effffd0 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127604.988632:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346b622c200/0xd718aadfd785ec03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffd0 expref: 6 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127604.988643:0:17939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346b622c200/0xd718aadfd785ec03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffd0 expref: 6 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127604.988651:0:17939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346b622c200, rc 0) 00000100:00100000:2.0:1789127604.988715:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+6:15187:x1876035771686784:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 145us (879us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127604.988723:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 114 00000100:00100000:3.0:1789127604.997137:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127604.997239:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771686912 00000100:00100000:2.0:1789127604.997248:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771686912 00000100:00100000:2.0:1789127604.997305:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:2.0:1789127604.997314:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+6:15187:x1876035771686912:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789127604.997451:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+6:15187:x1876035771686912:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 137us (322us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127604.997459:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 115 00000100:00100000:2.0:1789127605.014200:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127605.014304:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771687040 00000100:00100000:0.0:1789127605.014314:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771687040 00000100:00100000:0.0:1789127605.014382:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:0.0:1789127605.014392:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+6:15187:x1876035771687040:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789127605.014411:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127605.014428:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fede00/0xd718aadfd785ec0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6effffd7 expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127605.014455:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fede00/0xd718aadfd785ec0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffd7 expref: 7 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127605.014467:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fede00/0xd718aadfd785ec0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6effffd7 expref: 7 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127605.014475:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fede00, rc 0) 00000100:00100000:0.0:1789127605.014577:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+7:15187:x1876035771687040:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 186us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.014584:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 116 00000100:00100000:3.0:1789127605.016589:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127605.016688:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771687168 00000100:00100000:2.0:1789127605.016698:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771687168 00000100:00100000:2.0:1789127605.016750:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:2.0:1789127605.016760:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+7:15187:x1876035771687168:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789127605.016915:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+8:15187:x1876035771687168:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 156us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127605.016924:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 117 00000100:00100000:3.0:1789127605.019615:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127605.019889:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771687296 00000100:00100000:0.0:1789127605.019899:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771687296 00000100:00100000:0.0:1789127605.019952:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:0.0:1789127605.019961:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+8:15187:x1876035771687296:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789127605.020115:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+8:15187:x1876035771687296:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 154us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.020123:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 118 00000100:00100000:3.0:1789127605.027230:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127605.027276:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771687424 00000100:00100000:3.0:1789127605.027285:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771687424 00000100:00100000:3.0:1789127605.027333:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 119 00000100:00100000:3.0:1789127605.027342:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+8:15206:x1876035771687424:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127605.028004:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+8:15206:x1876035771687424:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 660us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127605.028013:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 119 00000100:00100000:0.0:1789127605.047865:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127605.047888:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789602816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127605.047972:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127605.048093:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789602816 00000100:00100000:2.0:1789127605.048101:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789602816 00000100:00100000:2.0:1789127605.048162:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127605.048172:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692920b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789602816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127605.048201:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789127605.048243:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692920b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789602816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127605.048250:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789127605.048316:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789127605.048350:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789602816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789127605.049482:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789603200:0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.049545:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127605.049575:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690402580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789603072:0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.049577:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690401e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789603712:0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.049598:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127605.049602:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127605.049615:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789604224:0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.049621:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789603584:0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.049640:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127605.049640:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127605.049654:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789604096:0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.049659:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789127605.049664:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789603328:0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.049673:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127605.049691:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789604224 00000100:00100000:0.0:1789127605.049697:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789604224 00000100:00100000:1.0:1789127605.049703:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789127605.049708:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789602944:0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.049734:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127605.049752:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690400f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789603456:0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.049773:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127605.049789:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789603968:0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.049809:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127605.049833:0:20454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789603200 00000100:00100000:1.0:1789127605.049836:0:20454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789603200 00000100:00100000:1.0:1789127605.049861:0:20454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789603712 00000100:00100000:1.0:1789127605.049864:0:20454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789603712 00000100:00100000:1.0:1789127605.049898:0:20454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789603584 00000100:00100000:1.0:1789127605.049901:0:20454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789603584 00000100:00100000:1.0:1789127605.049919:0:20454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127605.049927:0:20454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789603200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.049965:0:20454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929221c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789603200:12345-0@lo:400:kworker.0 Request processed in 39us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127605.049972:0:20454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789127605.049987:0:20454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789127605.049993:0:20454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692921a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789603712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.050012:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789604096 00000100:00100000:0.0:1789127605.050015:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789604096 00000100:00100000:1.0:1789127605.050018:0:20454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692921a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789603712:12345-0@lo:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127605.050024:0:20454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789127605.050030:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789603968 00000100:00100000:0.0:1789127605.050032:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789603968 00000100:00100000:0.0:1789127605.050047:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789127605.050052:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692923c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789604224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.050087:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692923c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789604224:12345-0@lo:400:kworker.0 Request processed in 35us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.050093:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789127605.050107:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789127605.050113:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789604096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.050147:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72aa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789604096:12345-0@lo:400:kworker.0 Request processed in 34us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.050162:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789127605.050175:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789127605.050178:0:20454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789127605.050180:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789603968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.050184:0:20454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789603584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.050208:0:20454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789603584:12345-0@lo:400:kworker.0 Request processed in 23us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.050208:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72ab840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3653:x1876035789603968:12345-0@lo:400:kworker.0 Request processed in 27us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.050214:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789127605.050221:0:20454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789127605.050233:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789127605.050237:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789603072 00000100:00080000:0.0:1789127605.050237:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127605.050239:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127605.050240:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789603072 00000100:00080000:0.0:1789127605.050241:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127605.050260:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789603456 00000100:00100000:1.0:1789127605.050262:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789603456 00010000:00080000:0.0:1789127605.050263:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b72abc00 x1876035789603968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127605.050272:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789127605.050276:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3653:1876035789603968:0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.050277:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789603072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.050287:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789603584:0@lo:400:kworker.0 00010000:00080000:0.0:1789127605.050300:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b72a8f00 x1876035789604096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127605.050307:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72aa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789603072:12345-0@lo:400:kworker.0 Request processed in 30us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.050309:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789604096:0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.050313:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789127605.050323:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789127605.050328:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789603456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.050329:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690402580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789603072:0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.050347:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127605.050358:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789603456:12345-0@lo:400:kworker.0 Request processed in 30us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.050377:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690401680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789603840:0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.050382:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789127605.050401:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127605.050409:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789602944 00000100:00100000:0.0:1789127605.050412:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789604352:0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.050413:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789602944 00000100:00100000:0.0:1789127605.050430:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127605.050434:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789127605.050439:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:3653:x1876035789602944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.050455:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904030c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789603200:0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.050465:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690401e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789603712:0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.050466:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:3653:x1876035789602944:12345-0@lo:400:kworker.0 Request processed in 26us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127605.050471:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00010000:00080000:0.0:1789127605.050474:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b72a83c0 x1876035789604224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127605.050482:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789604224:0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.050499:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789603328 00000100:00100000:0.0:1789127605.050501:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789603328 00000100:00100000:1.0:1789127605.050536:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789602944:0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.050536:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789603840 00000100:00100000:0.0:1789127605.050539:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789603840 00000100:00100000:1.0:1789127605.050547:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690400f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789603456:0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.050548:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789604352 00000100:00100000:0.0:1789127605.050550:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789604352 00000100:00080000:1.0:1789127605.050567:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127605.050568:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789127605.050573:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789603328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.050604:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929212c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789603328:12345-0@lo:400:kworker.0 Request processed in 30us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.050610:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1789127605.050618:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346904021c0 x1876035789603328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127605.050621:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789127605.050626:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789603840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.050628:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789603328:0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.050660:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929203c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3650:x1876035789603840:12345-0@lo:400:kworker.0 Request processed in 32us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.050666:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789127605.050671:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934690401680 x1876035789603840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789127605.050677:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789127605.050679:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690401680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3650:1876035789603840:0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.050682:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690402580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789604352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127605.051035:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690402580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3650:x1876035789604352:12345-0@lo:400:kworker.0 Request processed in 351us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.051042:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789127605.052026:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789127605.052040:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346aed12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789604480:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127605.052085:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127605.052124:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789604480 00000100:00100000:2.0:1789127605.052130:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789604480 00000100:00100000:2.0:1789127605.052164:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789127605.052172:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789604480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127605.052203:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789127605.052242:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789604480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127605.052248:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789127605.052287:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346aed12580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789604480:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789127605.053337:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346b72a9a40 x1876035789604352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789127605.053351:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3650:1876035789604352:0@lo:400:kworker.0 00000100:00100000:1.0:1789127605.063597:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789127605.063627:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690401e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789604608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789127605.063700:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127605.065398:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789604608 00000100:00100000:3.0:1789127605.065408:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789604608 00000100:00100000:3.0:1789127605.065467:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789127605.065488:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1876035789604608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127605.065548:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789127605.065612:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3652:x1876035789604608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127605.065619:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789127605.065776:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690401e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789604608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127605.065898:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127605.066011:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771687552 00000100:00100000:1.0:1789127605.066015:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771687552 00000100:00100000:1.0:1789127605.066059:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:1.0:1789127605.066066:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+8:15206:x1876035771687552:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127605.066181:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+8:15206:x1876035771687552:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 115us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127605.066188:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 121 00000100:00100000:3.0:1789127605.073447:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127605.073759:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771687680 00000100:00100000:2.0:1789127605.073770:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771687680 00000100:00100000:2.0:1789127605.073829:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:2.0:1789127605.073840:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+8:15206:x1876035771687680:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127605.073993:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+8:15206:x1876035771687680:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 154us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127605.074002:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 122 00000100:00100000:3.0:1789127605.080821:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127605.080990:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771687808 00000100:00100000:0.0:1789127605.081000:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771687808 00000100:00100000:0.0:1789127605.081063:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 123 00000100:00100000:0.0:1789127605.081072:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+8:15187:x1876035771687808:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789127605.081087:0:17940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127605.081103:0:17940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fec600/0xd718aadfd785ec11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000008 expref: -99 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127605.081126:0:17940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fec600/0xd718aadfd785ec11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000008 expref: 9 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127605.081135:0:17940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fec600/0xd718aadfd785ec11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000008 expref: 9 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127605.081144:0:17940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec600, rc 0) 00000100:00100000:0.0:1789127605.081193:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+9:15187:x1876035771687808:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 122us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.081200:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 123 00000100:00100000:0.0:1789127605.093636:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127605.093775:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771687936 00000100:00100000:1.0:1789127605.093786:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771687936 00000100:00100000:1.0:1789127605.093840:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 124 00000100:00100000:1.0:1789127605.093851:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+9:15187:x1876035771687936:12345-192.168.206.48@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789127605.093899:0:17938:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789127605.093917:0:17938:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789127605.093922:0:17938:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789127605.093925:0:17938:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789127605.093928:0:17938:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789127605.093930:0:17938:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789127605.095786:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+9:15187:x1876035771687936:12345-192.168.206.48@tcp:256:mount.lustre.0 Request processed in 1929us (2154us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127605.095800:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 124 00000100:00100000:3.0:1789127605.098430:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127605.098537:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771688064 00000100:00100000:2.0:1789127605.098546:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771688064 00000100:00100000:2.0:1789127605.098598:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:2.0:1789127605.098607:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+9:15187:x1876035771688064:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789127605.098621:0:17939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127605.098636:0:17939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346b622da00/0xd718aadfd785ec18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6f00000f expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127605.098660:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346b622da00/0xd718aadfd785ec18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00000f expref: 10 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127605.098670:0:17939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346b622da00/0xd718aadfd785ec18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00000f expref: 10 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127605.098695:0:17939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346b622da00, rc 0) 00000100:00100000:2.0:1789127605.098746:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+10:15187:x1876035771688064:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 140us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127605.098754:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 125 00000100:00100000:0.0:1789127605.101220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127605.101317:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771688192 00000100:00100000:1.0:1789127605.101327:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771688192 00000100:00100000:1.0:1789127605.101390:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:1.0:1789127605.101400:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+10:15187:x1876035771688192:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789127605.101596:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+10:15187:x1876035771688192:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 197us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127605.101604:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 126 00000100:00100000:3.0:1789127605.103664:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127605.103757:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771688320 00000100:00100000:0.0:1789127605.103766:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771688320 00000100:00100000:0.0:1789127605.103819:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 127 00000100:00100000:0.0:1789127605.103828:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934687631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+10:15187:x1876035771688320:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789127605.103971:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934687631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+10:15187:x1876035771688320:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 144us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.103979:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 127 00000100:00100000:3.0:1789127605.106817:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127605.106919:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771688448 00000100:00100000:2.0:1789127605.106929:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771688448 00000100:00100000:2.0:1789127605.106985:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:2.0:1789127605.106995:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+10:15211:x1876035771688448:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127605.107152:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec57450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+10:15211:x1876035771688448:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 158us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127605.107160:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 128 00000100:00100000:3.0:1789127605.110755:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127605.110853:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771688576 00000100:00100000:1.0:1789127605.110863:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771688576 00000100:00100000:1.0:1789127605.110926:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 129 00000100:00100000:1.0:1789127605.110934:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+10:15211:x1876035771688576:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127605.111087:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+10:15211:x1876035771688576:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 152us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127605.111095:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 129 00000100:00100000:3.0:1789127605.129654:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127605.129750:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127605.130298:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771688704 00000100:00100000:0.0:1789127605.130308:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771688704 00000100:00100000:0.0:1789127605.130353:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771688960 00000100:00100000:0.0:1789127605.130370:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771688960 00000100:00100000:0.0:1789127605.130399:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:0.0:1789127605.130407:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7394f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1876035771688704:12345-192.168.206.48@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789127605.130436:0:17946:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 1a1276a5-c9a3-44c0-94fa-011bc4d17ddb@192.168.206.48@tcp t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:0.0:1789127605.130485:0:17946:0:(genops.c:1385:class_connect()) connect: client 1a1276a5-c9a3-44c0-94fa-011bc4d17ddb, cookie 0xd718aadfd785ec1f 00000004:00100000:0.0:1789127605.130534:0:17946:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789127605.130735:0:17946:0:(import.c:65:import_set_state_nolock()) ffff9346b9d96000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127605.130797:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7394f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:2398:x1876035771688704:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 389us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.130806:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:0.0:1789127605.130825:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:0.0:1789127605.130829:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b73970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1876035771688960:12345-192.168.206.48@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789127605.130845:0:17946:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 1a1276a5-c9a3-44c0-94fa-011bc4d17ddb@192.168.206.48@tcp t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:0.0:1789127605.130875:0:17946:0:(genops.c:1385:class_connect()) connect: client 1a1276a5-c9a3-44c0-94fa-011bc4d17ddb, cookie 0xd718aadfd785ec26 00000004:00100000:0.0:1789127605.130902:0:17946:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789127605.131704:0:17946:0:(import.c:65:import_set_state_nolock()) ffff9346bfb21000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789127605.131851:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b73970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:2398:x1876035771688960:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 1018us (2099us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127605.131860:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:3.0:1789127605.139829:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127605.140019:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127605.150591:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127605.150692:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771688832 00000100:00100000:1.0:1789127605.150702:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771688832 00000100:00100000:1.0:1789127605.150820:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771689216 00000100:00100000:1.0:1789127605.150836:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771689216 00000100:00100000:1.0:1789127605.150863:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:1.0:1789127605.150873:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b7397c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:0:x1876035771688832:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789127605.150987:0:20455:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789127605.151079:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b7397c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:0:x1876035771688832:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 206us (11258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127605.151087:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:1.0:1789127605.151105:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:1.0:1789127605.151112:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:15187:x1876035771689216:12345-192.168.206.48@tcp:41:mount.lustre.0 00000100:00080000:2.0:1789127605.151121:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1789127605.151124:0:20455:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789127605.151146:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:15187:x1876035771689216:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 34us (11127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127605.151151:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:2.0:1789127605.152919:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771689088 00000100:00100000:2.0:1789127605.152932:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771689088 00000100:00100000:2.0:1789127605.153011:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:2.0:1789127605.153022:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:0:x1876035771689088:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789127605.153056:0:17945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789127605.153134:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:0:x1876035771689088:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 114us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127605.153143:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00080000:1.0:1789127605.153356:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789127605.161241:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127605.161337:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771689344 00000100:00100000:1.0:1789127605.161347:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771689344 00000100:00100000:1.0:1789127605.161415:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:1.0:1789127605.161426:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:15187:x1876035771689344:12345-192.168.206.48@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789127605.161542:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed12580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:15187:x1876035771689344:12345-192.168.206.48@tcp:40:mount.lustre.0 Request processed in 84us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127605.161551:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:1.0:1789127605.174727:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127605.174772:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127605.174796:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127605.174875:0:17957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771689728 00000100:00100000:3.0:1789127605.174894:0:17957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771689728 00000100:00100000:3.0:1789127605.174947:0:17957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:3.0:1789127605.174957:0:17957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:15187:x1876035771689728:12345-192.168.206.48@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789127605.175025:0:17957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:15187:x1876035771689728:12345-192.168.206.48@tcp:900:mount.lustre.0 Request processed in 70us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127605.175042:0:17957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:2.0:1789127605.175257:0:20454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771689472 00000100:00100000:2.0:1789127605.175262:0:20454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771689472 00000100:00100000:2.0:1789127605.175288:0:20454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771689600 00000100:00100000:2.0:1789127605.175291:0:20454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771689600 00000100:00100000:2.0:1789127605.175328:0:20454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:2.0:1789127605.175333:0:20454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2398:x1876035771689472:12345-192.168.206.48@tcp:8:mount.lustre.0 00000100:00100000:1.0:1789127605.175449:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:1.0:1789127605.175455:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1876035771689600:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789127605.175478:0:19456:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 1a1276a5-c9a3-44c0-94fa-011bc4d17ddb@192.168.206.48@tcp t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:1.0:1789127605.175504:0:19456:0:(genops.c:1385:class_connect()) connect: client 1a1276a5-c9a3-44c0-94fa-011bc4d17ddb, cookie 0xd718aadfd785ec2d 00002000:00100000:1.0:1789127605.175539:0:19456:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 1a1276a5-c9a3-44c0-94fa-011bc4d17ddb/ffff934588649800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789127605.175550:0:19456:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789127605.175704:0:19456:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789127605.175732:0:19456:0:(import.c:65:import_set_state_nolock()) ffff93458864c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127605.175766:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:2398:x1876035771689600:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 309us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127605.175772:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00010000:00080000:2.0:1789127605.175850:0:20454:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 1a1276a5-c9a3-44c0-94fa-011bc4d17ddb@192.168.206.48@tcp t0 exp 0000000000000000 cur 566 last 0 00000020:00000080:2.0:1789127605.175868:0:20454:0:(genops.c:1385:class_connect()) connect: client 1a1276a5-c9a3-44c0-94fa-011bc4d17ddb, cookie 0xd718aadfd785ec34 00002000:00100000:2.0:1789127605.175874:0:20454:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 1a1276a5-c9a3-44c0-94fa-011bc4d17ddb/ffff934587910800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789127605.175880:0:20454:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789127605.175989:0:20454:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789127605.176006:0:20454:0:(import.c:65:import_set_state_nolock()) ffff934587913000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127605.176046:0:20454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72ab0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:2398:x1876035771689472:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 698us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127605.176054:0:20454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:3.0:1789127605.179805:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000001:00100000:0.0:1789127605.180946:0:20272:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 1a1276a5-c9a3-44c0-94fa-011bc4d17ddb 00000001:00080000:0.0:1789127605.180961:0:20272:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:2.0:1789127605.189874:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771689856 00000100:00100000:2.0:1789127605.189888:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771689856 00000100:00100000:2.0:1789127605.189961:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:2.0:1789127605.189970:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:15187:x1876035771689856:12345-192.168.206.48@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789127605.191449:0:17948:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1391us 00000004:00200000:3.0:1789127605.209989:0:17948:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1789127605.210110:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:15187:x1876035771689856:12345-192.168.206.48@tcp:33:mount.lustre.0 Request processed in 20136us (30310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127605.210124:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00010000:00010000:2.0:1789127605.239855:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127605.387147:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127605.387231:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771689984 00000100:00100000:3.0:1789127605.387240:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771689984 00000100:00100000:3.0:1789127605.387295:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:3.0:1789127605.387303:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aed12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:15236:x1876035771689984:12345-192.168.206.48@tcp:101:mkdir.0 00010000:00010000:3.0:1789127605.387333:0:20455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127605.387354:0:20455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ec3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000040 expref: -99 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127605.387422:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c400/0xd718aadfd785ec42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127605.387434:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c400/0xd718aadfd785ec42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127605.387447:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c400/0xd718aadfd785ec42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127605.387495:0:20455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789127605.387499:0:20455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127605.387557:0:20455:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c400/0xd718aadfd785ec42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127605.387756:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ec3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000040 expref: 8 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127605.387773:0:20455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c400/0xd718aadfd785ec42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000040 expref: 7 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127605.387780:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586ef4400) 00010000:00010000:3.0:1789127605.387783:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127605.387786:0:20455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214c400, rc 0) 00000100:00100000:3.0:1789127605.387875:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aed12d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:15236:x1876035771689984:12345-192.168.206.48@tcp:101:mkdir.0 Request processed in 572us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127605.387882:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00010000:00010000:3.0:1789127606.264186:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789127606.584704:0:17978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1789127606.588625:0:19451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 1a1276a5-c9a3-44c0-94fa-011bc4d17ddb 00000100:00100000:1.0:1789127607.100539:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789604736:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789127607.100609:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127607.100771:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789604736 00000100:00100000:3.0:1789127607.100778:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789604736 00000100:00100000:3.0:1789127607.100834:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127607.100844:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789604736:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789127607.100874:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127607.100920:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789604736:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127607.100929:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789127607.104934:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127607.105005:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789604736:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789127607.241756:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127607.241846:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771690112 00000100:00100000:1.0:1789127607.241855:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771690112 00000100:00100000:1.0:1789127607.241937:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:1.0:1789127607.241948:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:15288:x1876035771690112:12345-192.168.206.48@tcp:41:lfs.0 00000004:00000024:1.0:1789127607.241982:0:17946:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:2.0:1789127607.242145:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789127607.242199:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:15288:x1876035771690112:12345-192.168.206.48@tcp:41:lfs.0 Request processed in 253us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127607.242206:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:2.0:1789127607.243836:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127607.243957:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771690240 00000100:00100000:0.0:1789127607.243965:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771690240 00000100:00100000:0.0:1789127607.244020:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:0.0:1789127607.244029:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:15288:x1876035771690240:12345-192.168.206.48@tcp:41:lfs.0 00000004:00000024:0.0:1789127607.244057:0:17947:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789127607.244131:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:15288:x1876035771690240:12345-192.168.206.48@tcp:41:lfs.0 Request processed in 103us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127607.244138:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00080000:2.0:1789127607.244233:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127607.247615:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127607.247713:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771690368 00000100:00100000:3.0:1789127607.247723:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771690368 00000100:00100000:3.0:1789127607.247850:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:3.0:1789127607.247860:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:15288:x1876035771690368:12345-192.168.206.48@tcp:13:lfs.0 00002000:00000024:3.0:1789127607.247885:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789127607.247975:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690400000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:15288:x1876035771690368:12345-192.168.206.48@tcp:13:lfs.0 Request processed in 116us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127607.247983:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00080000:2.0:1789127607.248682:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127607.256685:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127607.256818:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771690496 00000100:00100000:3.0:1789127607.256827:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771690496 00000100:00100000:3.0:1789127607.256903:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:3.0:1789127607.256918:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:15288:x1876035771690496:12345-192.168.206.48@tcp:13:lfs.0 00002000:00000024:3.0:1789127607.256950:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789127607.257065:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:15288:x1876035771690496:12345-192.168.206.48@tcp:13:lfs.0 Request processed in 148us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127607.257072:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00080000:1.0:1789127607.257239:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789127607.288270:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127607.500597:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127607.501548:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771690624 00000100:00100000:0.0:1789127607.501559:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771690624 00000100:00100000:0.0:1789127607.501618:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 130 00000100:00100000:0.0:1789127607.501627:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+10:15322:x1876035771690624:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789127607.501642:0:17940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127607.501659:0:17940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fed400/0xd718aadfd785ec49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000047 expref: -99 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127607.501703:0:17940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fed400/0xd718aadfd785ec49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000047 expref: 11 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127607.501714:0:17940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fed400/0xd718aadfd785ec49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000047 expref: 11 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127607.501724:0:17940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fed400, rc 0) 00000100:00100000:0.0:1789127607.501792:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+11:15322:x1876035771690624:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 166us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127607.501799:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 130 00000100:00100000:3.0:1789127607.508537:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127607.508678:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771690752 00000100:00100000:2.0:1789127607.508688:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771690752 00000100:00100000:2.0:1789127607.508746:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:2.0:1789127607.508771:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+11:15322:x1876035771690752:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789127607.508917:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec54450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+11:15322:x1876035771690752:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 147us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127607.508926:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 131 00000100:00100000:2.0:1789127607.515634:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127607.515748:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771690880 00000100:00100000:1.0:1789127607.515772:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771690880 00000100:00100000:1.0:1789127607.515828:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:1.0:1789127607.515838:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+11:15322:x1876035771690880:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789127607.515972:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec55850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+11:15322:x1876035771690880:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 134us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127607.515980:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 132 00000100:00100000:1.0:1789127607.522449:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127607.522720:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771691008 00000100:00100000:0.0:1789127607.522730:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771691008 00000100:00100000:0.0:1789127607.522786:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 133 00000100:00100000:0.0:1789127607.522795:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+11:15327:x1876035771691008:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789127607.522960:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+11:15327:x1876035771691008:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 165us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127607.522968:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 133 00000100:00100000:3.0:1789127607.545725:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127607.545900:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771691136 00000100:00100000:2.0:1789127607.545909:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771691136 00000100:00100000:2.0:1789127607.545967:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 134 00000100:00100000:2.0:1789127607.545976:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+11:15327:x1876035771691136:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127607.546141:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+11:15327:x1876035771691136:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 165us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127607.546152:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 134 00000100:00100000:2.0:1789127607.554481:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127607.554776:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771691264 00000100:00100000:1.0:1789127607.554786:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771691264 00000100:00100000:1.0:1789127607.554841:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 135 00000100:00100000:1.0:1789127607.554850:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+11:15327:x1876035771691264:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127607.555045:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+11:15327:x1876035771691264:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 195us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127607.555053:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 135 00000100:00100000:1.0:1789127607.573041:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127607.573193:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771691392 00000100:00100000:0.0:1789127607.573204:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771691392 00000100:00100000:0.0:1789127607.573260:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 136 00000100:00100000:0.0:1789127607.573270:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+11:15322:x1876035771691392:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789127607.573286:0:17940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127607.573303:0:17940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fec000/0xd718aadfd785ec50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000078 expref: -99 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127607.573330:0:17940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fec000/0xd718aadfd785ec50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000078 expref: 12 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127607.573340:0:17940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fec000/0xd718aadfd785ec50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000078 expref: 12 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127607.573364:0:17940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec000, rc 0) 00000100:00100000:0.0:1789127607.573421:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+12:15322:x1876035771691392:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 153us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127607.573429:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 136 00000100:00100000:3.0:1789127607.577320:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127607.577535:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771691520 00000100:00100000:2.0:1789127607.577546:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771691520 00000100:00100000:2.0:1789127607.577603:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 137 00000100:00100000:2.0:1789127607.577613:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+12:15322:x1876035771691520:12345-192.168.206.48@tcp:256:mount.lustre.0 20000000:01000000:2.0:1789127607.577637:0:17939:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789127607.577659:0:17939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789127607.577663:0:17939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789127607.577666:0:17939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789127607.577668:0:17939:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789127607.577671:0:17939:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:0.0:1789127607.585625:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+12:15322:x1876035771691520:12345-192.168.206.48@tcp:256:mount.lustre.0 Request processed in 8003us (8302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127607.585653:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 137 00000100:00100000:2.0:1789127607.593239:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127607.593317:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771691648 00000100:00100000:1.0:1789127607.593327:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771691648 00000100:00100000:1.0:1789127607.593396:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 138 00000100:00100000:1.0:1789127607.593407:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+12:15322:x1876035771691648:12345-192.168.206.48@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789127607.593424:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127607.593447:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93458858da00/0xd718aadfd785ec57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6f00007f expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127607.593477:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93458858da00/0xd718aadfd785ec57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00007f expref: 13 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127607.593487:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93458858da00/0xd718aadfd785ec57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00007f expref: 13 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127607.593538:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858da00, rc 0) 00000100:00100000:1.0:1789127607.593596:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+13:15322:x1876035771691648:12345-192.168.206.48@tcp:101:mount.lustre.0 Request processed in 190us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127607.593602:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 138 00000100:00100000:3.0:1789127607.599452:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127607.599558:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771691776 00000100:00100000:0.0:1789127607.599568:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771691776 00000100:00100000:0.0:1789127607.599622:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 139 00000100:00100000:0.0:1789127607.599632:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+13:15322:x1876035771691776:12345-192.168.206.48@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789127607.599794:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+13:15322:x1876035771691776:12345-192.168.206.48@tcp:501:mount.lustre.0 Request processed in 163us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127607.599802:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 139 00000100:00100000:2.0:1789127607.603097:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127607.603237:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771691904 00000100:00100000:0.0:1789127607.603246:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771691904 00000100:00100000:0.0:1789127607.603300:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 140 00000100:00100000:0.0:1789127607.603310:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346aec55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+13:15322:x1876035771691904:12345-192.168.206.48@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789127607.603452:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346aec55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+13:15322:x1876035771691904:12345-192.168.206.48@tcp:503:mount.lustre.0 Request processed in 144us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127607.603460:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 140 00000100:00100000:2.0:1789127607.607247:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127607.607365:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771692032 00000100:00100000:1.0:1789127607.607375:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771692032 00000100:00100000:1.0:1789127607.607430:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 141 00000100:00100000:1.0:1789127607.607440:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+13:15330:x1876035771692032:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789127607.607609:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+13:15330:x1876035771692032:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 170us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127607.607617:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 141 00000100:00100000:3.0:1789127607.629792:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127607.630002:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771692160 00000100:00100000:2.0:1789127607.630011:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771692160 00000100:00100000:2.0:1789127607.630301:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 142 00000100:00100000:2.0:1789127607.630312:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+13:15330:x1876035771692160:12345-192.168.206.48@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789127607.631677:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+13:15330:x1876035771692160:12345-192.168.206.48@tcp:502:llog_process_th.0 Request processed in 1361us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127607.631689:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 142 00000100:00100000:2.0:1789127607.657377:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127607.657421:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127607.657462:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771692288 00000100:00100000:3.0:1789127607.657473:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771692288 00000100:00100000:1.0:1789127607.657536:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771692544 00000100:00100000:1.0:1789127607.657540:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771692544 00000100:00100000:3.0:1789127607.657544:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:3.0:1789127607.657553:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2398:x1876035771692288:12345-192.168.206.48@tcp:38:mount.lustre.0 00000100:00100000:1.0:1789127607.657562:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:1.0:1789127607.657567:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2398:x1876035771692544:12345-192.168.206.48@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789127607.657581:0:17945:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 5bf94dad-08b7-4dca-adb6-c077dbc03986@192.168.206.48@tcp t0 exp 0000000000000000 cur 568 last 0 00010000:00080000:1.0:1789127607.657581:0:17946:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 5bf94dad-08b7-4dca-adb6-c077dbc03986@192.168.206.48@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:3.0:1789127607.657615:0:17945:0:(genops.c:1385:class_connect()) connect: client 5bf94dad-08b7-4dca-adb6-c077dbc03986, cookie 0xd718aadfd785ec5e 00000020:00000080:1.0:1789127607.657615:0:17946:0:(genops.c:1385:class_connect()) connect: client 5bf94dad-08b7-4dca-adb6-c077dbc03986, cookie 0xd718aadfd785ec65 00000004:00100000:3.0:1789127607.657638:0:17945:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000004:00100000:1.0:1789127607.657687:0:17946:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789127607.657720:0:17945:0:(import.c:65:import_set_state_nolock()) ffff934587902000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789127607.657790:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:2398:x1876035771692288:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 237us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127607.657798:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00080000:1.0:1789127607.657944:0:17946:0:(import.c:65:import_set_state_nolock()) ffff93458864b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127607.658312:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:2398:x1876035771692544:12345-192.168.206.48@tcp:38:mount.lustre.0 Request processed in 741us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127607.658320:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:0.0:1789127607.671653:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127607.671696:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127607.671788:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127607.679165:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771692800 00000100:00100000:3.0:1789127607.679181:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771692800 00000100:00100000:3.0:1789127607.679308:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771692416 00000100:00100000:3.0:1789127607.679312:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771692416 00000100:00100000:3.0:1789127607.679326:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771692672 00000100:00100000:3.0:1789127607.679328:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771692672 00000100:00100000:2.0:1789127607.679402:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:2.0:1789127607.679415:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690401e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+7:15322:x1876035771692800:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789127607.679449:0:20455:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789127607.679550:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690401e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+7:15322:x1876035771692800:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 137us (7905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127607.679557:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:2.0:1789127607.679577:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:2.0:1789127607.679585:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690401680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:0:x1876035771692416:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789127607.679596:0:20455:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789127607.679620:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690401680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:0:x1876035771692416:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 36us (7923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127607.679627:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00080000:0.0:1789127607.680664:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789127607.680742:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127607.680972:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:3.0:1789127607.680984:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:0:x1876035771692672:12345-192.168.206.48@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789127607.681005:0:17945:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127607.682241:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:0:x1876035771692672:12345-192.168.206.48@tcp:41:mount.lustre.0 Request processed in 1252us (10445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127607.682270:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:0.0:1789127607.686966:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127607.689031:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771692928 00000100:00100000:1.0:1789127607.689079:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771692928 00000100:00100000:1.0:1789127607.689152:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:1.0:1789127607.689163:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690400f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:15322:x1876035771692928:12345-192.168.206.48@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789127607.689255:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690400f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:15322:x1876035771692928:12345-192.168.206.48@tcp:40:mount.lustre.0 Request processed in 94us (2299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127607.689267:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1789127607.692443:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127607.692492:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127607.692649:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127607.692717:0:17957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771693312 00000100:00100000:3.0:1789127607.692726:0:17957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771693312 00000100:00100000:3.0:1789127607.692813:0:17957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:3.0:1789127607.692824:0:17957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692954780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:15322:x1876035771693312:12345-192.168.206.48@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789127607.692895:0:17957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692954780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:15322:x1876035771693312:12345-192.168.206.48@tcp:900:mount.lustre.0 Request processed in 74us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127607.692902:0:17957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:1.0:1789127607.692936:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771693056 00000100:00100000:1.0:1789127607.692941:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771693056 00000100:00100000:1.0:1789127607.692959:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771693184 00000100:00100000:1.0:1789127607.692961:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771693184 00000100:00100000:1.0:1789127607.692978:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1789127607.692983:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690400b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2398:x1876035771693056:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789127607.693007:0:19456:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 5bf94dad-08b7-4dca-adb6-c077dbc03986@192.168.206.48@tcp t0 exp 0000000000000000 cur 568 last 0 00000020:00000080:1.0:1789127607.693054:0:19456:0:(genops.c:1385:class_connect()) connect: client 5bf94dad-08b7-4dca-adb6-c077dbc03986, cookie 0xd718aadfd785ec6c 00002000:00100000:1.0:1789127607.693067:0:19456:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5bf94dad-08b7-4dca-adb6-c077dbc03986/ffff93458864f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789127607.693078:0:19456:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1789127607.693118:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:2.0:1789127607.693124:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692955e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2398:x1876035771693184:12345-192.168.206.48@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789127607.693140:0:20028:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 5bf94dad-08b7-4dca-adb6-c077dbc03986@192.168.206.48@tcp t0 exp 0000000000000000 cur 568 last 0 00002000:00080000:1.0:1789127607.693158:0:19456:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000020:00000080:2.0:1789127607.693168:0:20028:0:(genops.c:1385:class_connect()) connect: client 5bf94dad-08b7-4dca-adb6-c077dbc03986, cookie 0xd718aadfd785ec73 00002000:00100000:2.0:1789127607.693174:0:20028:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5bf94dad-08b7-4dca-adb6-c077dbc03986/ffff93469837b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113987 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789127607.693180:0:20028:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789127607.693183:0:19456:0:(import.c:65:import_set_state_nolock()) ffff93458864e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789127607.693212:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690400b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:2398:x1876035771693056:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 226us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127607.693218:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00002000:00080000:2.0:1789127607.693225:0:20028:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789127607.693240:0:20028:0:(import.c:65:import_set_state_nolock()) ffff93469837e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789127607.693264:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692955e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:2398:x1876035771693184:12345-192.168.206.48@tcp:8:mount.lustre.0 Request processed in 138us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127607.693270:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:3.0:1789127607.694886:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127607.694976:0:17949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771693440 00000100:00100000:1.0:1789127607.694984:0:17949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771693440 00000100:00100000:1.0:1789127607.695041:0:17949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:1.0:1789127607.695096:0:17949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:15322:x1876035771693440:12345-192.168.206.48@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789127607.695181:0:17949:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789127607.695270:0:17949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:15322:x1876035771693440:12345-192.168.206.48@tcp:33:mount.lustre.0 Request processed in 178us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127607.695278:0:17949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:1.0:1789127607.837736:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127607.837829:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771693568 00000100:00100000:3.0:1789127607.837839:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771693568 00000100:00100000:3.0:1789127607.837900:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:3.0:1789127607.837911:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:15356:x1876035771693568:12345-192.168.206.48@tcp:101:mkdir.0 00010000:00010000:3.0:1789127607.837929:0:17945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127607.837949:0:17945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ec7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f0000b0 expref: -99 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127607.838009:0:17945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ec81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127607.838022:0:17945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ec81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127607.838035:0:17945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ec81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127607.838076:0:17945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789127607.838091:0:17945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127607.838113:0:17945:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ec81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127607.838138:0:17945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ec7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000b0 expref: 8 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127607.838157:0:17945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ec81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000b0 expref: 7 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127607.838166:0:17945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586ef4400) 00010000:00010000:3.0:1789127607.838169:0:17945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127607.838173:0:17945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214d600, rc 0) 00000100:00100000:3.0:1789127607.838236:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72aad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bf94dad-08b7-4dca-adb6-c077dbc03986+7:15356:x1876035771693568:12345-192.168.206.48@tcp:101:mkdir.0 Request processed in 327us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127607.838244:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:3.0:1789127608.119976:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789604864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127608.120055:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127608.120267:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789604992:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789127608.120295:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127608.120328:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789604864 00000100:00100000:3.0:1789127608.120334:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789604864 00000100:00100000:3.0:1789127608.120396:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789604992 00000100:00100000:3.0:1789127608.120399:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789604992 00000100:00100000:3.0:1789127608.120414:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789127608.120422:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789604864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127608.120452:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127608.120506:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789604864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127608.120536:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789127608.120552:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789127608.120552:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789604864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127608.120558:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789604992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789127608.120573:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789127608.120615:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789604992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 56us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127608.120621:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789127608.120926:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72aa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789604992:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789127608.311935:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789127608.890187:0:18702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789127609.335957:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127610.168636:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127610.168656:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789605120:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127610.168719:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127610.168773:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789605120 00000100:00100000:2.0:1789127610.168778:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789605120 00000100:00100000:2.0:1789127610.168829:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789127610.168837:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789605120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127610.168860:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789127610.168893:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ced00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789605120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 58us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127610.168899:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1789127610.168916:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127610.168950:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789605120:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127610.169593:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127610.169605:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789605248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127610.169636:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127610.169668:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789605248 00000100:00100000:2.0:1789127610.169672:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789605248 00000100:00100000:2.0:1789127610.169702:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789127610.169710:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789605248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127610.169727:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789127610.169759:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878cd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789605248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 50us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127610.169765:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789127610.169780:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127610.169800:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789605248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127610.171653:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789605632:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.171712:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127610.171742:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789606144:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.171768:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127610.171784:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789606656:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.171801:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127610.171818:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789127610.171823:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789605504:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.171857:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127610.171882:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789606016:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.171898:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127610.171910:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789606528:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.171933:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127610.171958:0:19455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789605632 00000100:00100000:2.0:1789127610.171964:0:19455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789605632 00000100:00100000:2.0:1789127610.172009:0:19455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789606016 00000100:00100000:2.0:1789127610.172011:0:19455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789606016 00000100:00100000:2.0:1789127610.172029:0:19455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127610.172035:0:19455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789605632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.172075:0:19455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789605632:12345-0@lo:400:kworker.0 Request processed in 39us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127610.172081:0:19455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789127610.172094:0:19455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127610.172099:0:19455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789606016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.172118:0:19455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789606016:12345-0@lo:400:kworker.0 Request processed in 19us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127610.172123:0:19455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789127610.172138:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789606144 00000100:00100000:2.0:1789127610.172140:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789606144 00000100:00100000:2.0:1789127610.172157:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789606656 00000100:00100000:2.0:1789127610.172159:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789606656 00000100:00100000:2.0:1789127610.172168:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789606528 00000100:00100000:2.0:1789127610.172170:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789606528 00000100:00100000:2.0:1789127610.172179:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789127610.172184:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789606144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.172217:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3653:x1876035789606144:12345-0@lo:400:kworker.0 Request processed in 32us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127610.172223:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789127610.172234:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127610.172240:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789606656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.172268:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3653:x1876035789606656:12345-0@lo:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127610.172274:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789127610.172283:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789127610.172288:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789606528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.172306:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789606528:12345-0@lo:400:kworker.0 Request processed in 18us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127610.172310:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789127610.172327:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789605504 00000100:00100000:2.0:1789127610.172330:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789605504 00000100:00100000:2.0:1789127610.172368:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789127610.172375:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789605504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.175432:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789605504:12345-0@lo:400:kworker.0 Request processed in 3049us (3566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127610.175446:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789127610.175532:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346a5388f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789605760:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.175569:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127610.175788:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789606272:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.175810:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127610.175829:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789127610.175834:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9345878ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789605376:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.175857:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127610.175881:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789605888:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.175900:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127610.175914:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789606400:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.175950:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127610.175977:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789605376 00000100:00100000:2.0:1789127610.175983:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789605376 00000100:00100000:2.0:1789127610.176021:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789127610.176029:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:3650:x1876035789605376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.176064:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:3650:x1876035789605376:12345-0@lo:400:kworker.0 Request processed in 36us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127610.176072:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789127610.176099:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789605888 00000100:00100000:2.0:1789127610.176102:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789605888 00000100:00100000:2.0:1789127610.176123:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789127610.176129:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789605888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.176157:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789605888:12345-0@lo:400:kworker.0 Request processed in 29us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127610.176162:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789127610.176180:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789605760 00000100:00100000:2.0:1789127610.176182:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789605760 00000100:00100000:2.0:1789127610.176199:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789606272 00000100:00100000:2.0:1789127610.176200:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789606272 00000100:00100000:2.0:1789127610.176214:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789606400 00000100:00100000:2.0:1789127610.176216:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789606400 00000100:00100000:2.0:1789127610.176229:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127610.176234:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789605760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.176261:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3650:x1876035789605760:12345-0@lo:400:kworker.0 Request processed in 27us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127610.176267:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789127610.176279:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789127610.176284:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789606272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.176319:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3650:x1876035789606272:12345-0@lo:400:kworker.0 Request processed in 35us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127610.176325:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789127610.176346:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789127610.176352:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789606400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.176377:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3650:x1876035789606400:12345-0@lo:400:kworker.0 Request processed in 25us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127610.176383:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1789127610.176403:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127610.176408:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127610.176410:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127610.176413:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127610.176448:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ccb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789605376:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.176460:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789605888:0@lo:400:kworker.0 00010000:00080000:2.0:1789127610.176471:0:3650:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346928f6940 x1876035789606400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127610.176481:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3650:1876035789606400:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.176492:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346a5388f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3650:1876035789605760:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.176501:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3650:1876035789606272:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.176560:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789605504:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.176571:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789606016:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.176583:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789606528:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.176605:0:3653:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1789127610.176615:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9345878ce940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789605632:0@lo:400:kworker.0 00000100:00100000:2.0:1789127610.176628:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3653:1876035789606144:0@lo:400:kworker.0 00010000:00080000:2.0:1789127610.176640:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9346928f5a40 x1876035789606656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127626 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127610.176649:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3653:1876035789606656:0@lo:400:kworker.0 00000100:00100000:0.0:1789127610.182486:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789127610.182506:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789606784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127610.182590:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127610.182712:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789606784 00000100:00100000:2.0:1789127610.182720:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789606784 00000100:00100000:2.0:1789127610.182775:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789127610.182784:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692956580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789606784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127610.182806:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789127610.182849:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692956580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789606784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127610.182856:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789127610.183325:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789606784:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789127610.330144:0:20832:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1789127610.360668:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789127610.684278:0:17925:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5bf94dad-08b7-4dca-adb6-c077dbc03986 00000001:00100000:1.0:1789127610.684290:0:17925:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1a1276a5-c9a3-44c0-94fa-011bc4d17ddb 00000001:00100000:3.0:1789127610.684405:0:18681:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5bf94dad-08b7-4dca-adb6-c077dbc03986 00000001:00100000:3.0:1789127610.684414:0:18681:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 1a1276a5-c9a3-44c0-94fa-011bc4d17ddb 00010000:00010000:2.0:1789127611.386597:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127612.216804:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789127612.216824:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789606912:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789127612.216887:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127612.216935:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789606912 00000100:00100000:1.0:1789127612.216942:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789606912 00000100:00080000:0.0:1789127612.216988:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789127612.217006:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789127612.217017:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b72a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789606912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789127612.217047:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789127612.217100:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b72a83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789606912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127612.217107:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789127612.217156:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789606912:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1789127612.409972:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127612.925204:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127612.925252:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127612.925306:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127612.925343:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127612.925366:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127612.925387:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127612.925406:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127612.925424:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127612.925458:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127612.925486:0:20454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771694208 00000100:00100000:2.0:1789127612.925494:0:20454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771694208 00000100:00100000:2.0:1789127612.925577:0:20454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771694720 00000100:00100000:2.0:1789127612.925581:0:20454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771694720 00000100:00100000:2.0:1789127612.925595:0:20454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771694080 00000100:00100000:2.0:1789127612.925598:0:20454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771694080 00000100:00100000:2.0:1789127612.925610:0:20454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771694592 00000100:00100000:2.0:1789127612.925612:0:20454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771694592 00000100:00100000:2.0:1789127612.925628:0:20454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1789127612.925638:0:20454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:2399:x1876035771694208:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127612.925705:0:20454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:2399:x1876035771694208:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 68us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127612.925713:0:20454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:2.0:1789127612.925730:0:20454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1789127612.925736:0:20454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:2399:x1876035771694720:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127612.925775:0:20454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:2399:x1876035771694720:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 39us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127612.925781:0:20454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1789127612.925793:0:20454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1789127612.925799:0:20454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:2399:x1876035771694080:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127612.925824:0:20454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:2399:x1876035771694080:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127612.925830:0:20454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1789127612.925842:0:20454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:2.0:1789127612.925848:0:20454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:2399:x1876035771694592:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127612.925878:0:20454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:2399:x1876035771694592:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 29us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127612.925884:0:20454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:2.0:1789127612.925901:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771693952 00000100:00100000:2.0:1789127612.925904:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771693952 00000100:00100000:2.0:1789127612.925923:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771694464 00000100:00100000:2.0:1789127612.925925:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771694464 00000100:00100000:2.0:1789127612.925935:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771693824 00000100:00100000:2.0:1789127612.925937:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771693824 00000100:00100000:2.0:1789127612.925946:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771694336 00000100:00100000:2.0:1789127612.925947:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771694336 00000100:00100000:2.0:1789127612.925959:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:2.0:1789127612.925965:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:2399:x1876035771693952:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127612.925989:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:2399:x1876035771693952:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 25us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127612.925995:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:2.0:1789127612.926007:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:2.0:1789127612.926013:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+5:2399:x1876035771694464:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127612.926034:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+5:2399:x1876035771694464:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 22us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127612.926040:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:2.0:1789127612.926050:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:2.0:1789127612.926056:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:2399:x1876035771693824:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127612.926088:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:2399:x1876035771693824:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 31us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127612.926102:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:2.0:1789127612.926114:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:2.0:1789127612.926120:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692b4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:2399:x1876035771694336:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:2.0:1789127612.926149:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692b4e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:2399:x1876035771694336:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 29us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127612.926155:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00080000:2.0:1789127612.926186:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789127612.926190:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127612.926192:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127612.926194:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127612.926410:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771693696 00000100:00100000:3.0:1789127612.926416:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771693696 00000100:00100000:3.0:1789127612.926453:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 144 00000100:00100000:3.0:1789127612.926462:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+13:2399:x1876035771693696:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127612.926527:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+13:2399:x1876035771693696:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 47us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127612.926534:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 144 00000100:00100000:3.0:1789127613.240796:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127613.240817:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789607040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127613.240889:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127613.240942:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789607040 00000100:00100000:3.0:1789127613.240949:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789607040 00000100:00100000:3.0:1789127613.240991:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789127613.241000:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789607040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789127613.241029:0:17951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789127613.241078:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3653:x1876035789607040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127613.241086:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789127613.241129:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3653:1876035789607040:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789127613.244249:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789127613.245379:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789607168:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789127613.245450:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127613.245748:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789607168 00000100:00100000:1.0:1789127613.245756:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789607168 00000100:00100000:1.0:1789127613.245929:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789127613.245939:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789607168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127613.245974:0:17950:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789127613.246026:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692957480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789607168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127613.246033:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789127613.246102:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789607168:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789127613.432707:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789127613.442789:0:20979:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd8579140 20000000:00000080:3.0:1789127613.442805:0:20979:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9346b9154800 uarg=0000000000000000 20000000:01000000:3.0:1789127613.442853:0:20979:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789127613.442859:0:20979:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789127613.442863:0:20979:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789127613.443364:0:20980:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 19 20000000:00000400:2.0:1789127613.443947:0:20979:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789127613.451753:0:20979:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789127613.451909:0:20979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127613.451929:0:20979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e91d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e916 expref: 23 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127613.451937:0:20979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9345886d6800/0xd718aadfd785e92b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e924 expref: 23 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127613.451944:0:20979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff934587fec800/0xd718aadfd785e96a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e963 expref: 23 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127613.451951:0:20979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93468501b400/0xd718aadfd785ea04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785e9fd expref: 23 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127613.451961:0:20979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9346b622da00/0xd718aadfd785ec18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00000f expref: 12 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127613.451985:0:20979:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff93458858da00/0xd718aadfd785ec57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00007f expref: 12 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127613.451992:0:20979:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127613.452033:0:20979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93458858da00/0xd718aadfd785ec57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00007f expref: 12 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127613.452046:0:20979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93458858da00/0xd718aadfd785ec57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00007f expref: 12 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127613.452060:0:20979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1876035789607296:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127613.452197:0:20979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9346b622da00/0xd718aadfd785ec18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00000f expref: 12 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127613.452206:0:20979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9346b622da00/0xd718aadfd785ec18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00000f expref: 12 pid: 17939 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127613.452214:0:20979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346a5388f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1876035789607424:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127613.452246:0:20979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff93468501b400/0xd718aadfd785ea04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785e9fd expref: 23 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127613.452254:0:20979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff93468501b400/0xd718aadfd785ea04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785e9fd expref: 23 pid: 17939 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127613.452263:0:20979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1876035789607552:0@lo:104: 00000100:00100000:2.0:1789127613.452300:0:20979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127613.452364:0:20979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff934587fec800/0xd718aadfd785e96a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785e963 expref: 23 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127613.452373:0:20979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff934587fec800/0xd718aadfd785e96a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785e963 expref: 23 pid: 17940 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127613.452381:0:20979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1876035789607680:0@lo:104: 00000100:00100000:2.0:1789127613.452400:0:20979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127613.452496:0:20979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9345886d6800/0xd718aadfd785e92b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785e924 expref: 23 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127613.452505:0:20979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9345886d6800/0xd718aadfd785e92b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785e924 expref: 23 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127613.452540:0:20979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1876035789607808:0@lo:104: 00000100:00100000:2.0:1789127613.452559:0:20979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789127613.452572:0:20979:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e91d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd718aadfd785e916 expref: 23 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127613.452581:0:20979:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e91d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd718aadfd785e916 expref: 23 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127613.452588:0:20979:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346928f7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1876035789607936:0@lo:104: 00000100:00100000:2.0:1789127613.452603:0:20979:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127613.452610:0:20979:0:(client.c:2715:ptlrpc_set_wait()) set ffff934688af3e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127613.452781:0:17928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789607552 00000100:00100000:1.0:1789127613.452788:0:17928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789607552 00000100:00100000:1.0:1789127613.452825:0:17928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789607680 00000100:00100000:1.0:1789127613.452827:0:17928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789607680 00000100:00100000:1.0:1789127613.452847:0:17928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789607808 00000100:00100000:1.0:1789127613.452849:0:17928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789607808 00000100:00100000:1.0:1789127613.452857:0:17928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789607936 00000100:00100000:1.0:1789127613.452859:0:17928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789607936 00000100:00100000:1.0:1789127613.452870:0:17928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127613.452878:0:17928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+6:20979:x1876035789607552:12345-0@lo:104: 00010000:00010000:1.0:1789127613.452889:0:17928:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785ea04 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.452942:0:17928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789127613.452948:0:17928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+6:20979:x1876035789607552:12345-0@lo:104: Request processed in 71us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127613.452955:0:17928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789127613.452968:0:17928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789127613.452973:0:17928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+5:20979:x1876035789607680:12345-0@lo:104: 00010000:00010000:1.0:1789127613.452980:0:17928:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e96a expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453005:0:17928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789127613.453010:0:17928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f5680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+5:20979:x1876035789607680:12345-0@lo:104: Request processed in 37us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127613.453015:0:17928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789127613.453024:0:17928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127613.453029:0:17928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346928f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+4:20979:x1876035789607808:12345-0@lo:104: 00010000:00010000:1.0:1789127613.453036:0:17928:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e92b expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453075:0:17928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789127613.453080:0:17928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346928f6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+4:20979:x1876035789607808:12345-0@lo:104: Request processed in 51us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127613.453086:0:17928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127613.453096:0:17928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789127613.453101:0:17928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ce940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+3:20979:x1876035789607936:12345-0@lo:104: 00010000:00010000:1.0:1789127613.453107:0:17928:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e91d expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453127:0:17928:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789127613.453131:0:17928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ce940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+3:20979:x1876035789607936:12345-0@lo:104: Request processed in 31us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127613.453136:0:17928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789127613.453149:0:20456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789127613.453154:0:20456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785ea04 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453161:0:20456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7200 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127613.453165:0:20456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785ea04 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453174:0:20456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785ea04 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127613.453181:0:20456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785ea04 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127613.453187:0:20456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127613.453217:0:20456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785ea04 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453224:0:20456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127613.453240:0:20456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785ea04 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453247:0:20456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9345886d7200/0xd718aadfd785e9fd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785ea04 expref: -99 pid: 20271 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453258:0:20456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789127613.453261:0:20456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e96a expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453267:0:20456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7800 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127613.453269:0:20456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785e96a expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453276:0:20456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785e96a expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127613.453281:0:20456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785e96a expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127613.453286:0:20456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127613.453297:0:20456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e96a expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453303:0:20456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127613.453308:0:20456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e96a expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453333:0:20456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9345886d7800/0xd718aadfd785e963 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e96a expref: -99 pid: 19450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453341:0:20456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789127613.453344:0:20456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e92b expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453350:0:20456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d7a00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127613.453353:0:20456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785e92b expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453360:0:20456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785e92b expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127613.453366:0:20456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785e92b expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127613.453371:0:20456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127613.453381:0:20456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e92b expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453387:0:20456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127613.453399:0:20456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e92b expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453415:0:20456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9345886d7a00/0xd718aadfd785e924 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e92b expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453423:0:20456:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127613.453430:0:20456:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd718aadfd785e91d expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453436:0:20456:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9345886d6c00 already unused, calling callback (ffffffffc146dc20) 10000000:00010000:1.0:1789127613.453439:0:20456:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd718aadfd785e91d expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453446:0:20456:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd718aadfd785e91d expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789127613.453452:0:20456:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd718aadfd785e91d expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789127613.453457:0:20456:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789127613.453469:0:20456:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e91d expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453474:0:20456:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789127613.453479:0:20456:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e91d expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453485:0:20456:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.148@tcp lock: ffff9345886d6c00/0xd718aadfd785e916 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd718aadfd785e91d expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.453497:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127613.453498:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127613.453500:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127613.453506:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127613.453534:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789127613.454222:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789608448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127613.454264:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127613.454304:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789127613.454309:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789608320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127613.454339:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127613.454364:0:17932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789608448 00000100:00100000:3.0:1789127613.454369:0:17932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789608448 00010000:00010000:3.0:1789127613.454390:0:17932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e91d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e916 expref: 24 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127613.454479:0:17932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789608320 00000100:00100000:3.0:1789127613.454482:0:17932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789608320 00010000:00010000:3.0:1789127613.454494:0:17932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9345886d6800/0xd718aadfd785e92b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e924 expref: 25 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127613.454525:0:17932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127613.454532:0:17932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+25:3653:x1876035789608448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127613.454543:0:17932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127613.454556:0:17932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e91d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e916 expref: 25 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127613.454565:0:17932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e91d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785e916 expref: 25 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127613.454581:0:17932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127613.454608:0:17932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+25:3653:x1876035789608448:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127613.454614:0:17932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789127613.454630:0:17932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127613.454635:0:17932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:3653:x1876035789608320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789127613.454641:0:17932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127613.454645:0:17932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9345886d6800/0xd718aadfd785e92b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e924 expref: 24 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127613.454653:0:17932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9345886d6800/0xd718aadfd785e92b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785e924 expref: 24 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127613.454661:0:17932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127613.454676:0:17932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:3653:x1876035789608320:12345-0@lo:103:ldlm_bl.0 Request processed in 42us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127613.454681:0:17932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789127613.454713:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789608320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789127613.454720:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690404000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789608448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127613.454823:0:20979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f5a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1876035789607552:0@lo:104: 00000100:00100000:2.0:1789127613.454840:0:20979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f6d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1876035789607680:0@lo:104: 00010000:00010000:2.0:1789127613.454849:0:20979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9345886d6800/0xd718aadfd785e92b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785e924 expref: 23 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127613.454869:0:20979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f7c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1876035789607808:0@lo:104: 00010000:00010000:2.0:1789127613.454879:0:20979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9345886d7c00/0xd718aadfd785e91d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785e916 expref: 22 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127613.454886:0:20979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346928f7840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1876035789607936:0@lo:104: 00000100:00100000:0.0:1789127613.456869:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789608064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127613.456922:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127613.456962:0:3650:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789127613.456968:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b72a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789608192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127613.457277:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127613.457615:0:17930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789608064 00000100:00100000:1.0:1789127613.457623:0:17930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789608064 00010000:00010000:1.0:1789127613.457666:0:17930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93468501b400/0xd718aadfd785ea04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e9fd expref: 22 pid: 17939 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127613.457697:0:17930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789608192 00000100:00100000:1.0:1789127613.457700:0:17930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789608192 00010000:00010000:1.0:1789127613.457712:0:17930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff934587fec800/0xd718aadfd785e96a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e963 expref: 23 pid: 17940 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127613.457727:0:17930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127613.457735:0:17930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692956d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:3650:x1876035789608064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127613.457747:0:17930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127613.457753:0:17930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93468501b400/0xd718aadfd785ea04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e9fd expref: 23 pid: 17939 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.457763:0:17930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93468501b400/0xd718aadfd785ea04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785e9fd expref: 23 pid: 17939 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.457779:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93468501b400/0xd718aadfd785ea04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785e9fd expref: 23 pid: 17939 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.457793:0:17930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127613.457829:0:17930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692956d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:3650:x1876035789608064:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127613.458017:0:17930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789127613.458034:0:17930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789127613.458041:0:17930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692954b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:3650:x1876035789608192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789127613.458049:0:17930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127613.458054:0:17930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff934587fec800/0xd718aadfd785e96a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd718aadfd785e963 expref: 21 pid: 17940 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.458074:0:17930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff934587fec800/0xd718aadfd785e96a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd718aadfd785e963 expref: 21 pid: 17940 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.458086:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff934587fec800/0xd718aadfd785e96a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd718aadfd785e963 expref: 21 pid: 17940 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.458095:0:17930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127613.458122:0:17930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692954b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:3650:x1876035789608192:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (845us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127613.458127:0:17930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789127613.458294:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72a8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789608192:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789127613.458304:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b72abc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3650:1876035789608064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789127613.461130:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127613.461147:0:20979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1876035789607296:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127613.461160:0:20979:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346a5388f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20979:1876035789607424:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127613.461177:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00010000:00010000:3.0:1789127613.461208:0:20979:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127613.461266:0:17930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771694848 00000100:00100000:0.0:1789127613.461269:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771694976 00000100:00100000:1.0:1789127613.461272:0:17930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771694848 00000100:00100000:0.0:1789127613.461272:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771694976 00010000:00010000:1.0:1789127613.461304:0:17930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff93458858da00/0xd718aadfd785ec57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00007f expref: 14 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127613.461304:0:17931:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9346b622da00/0xd718aadfd785ec18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00000f expref: 14 pid: 17939 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127613.461350:0:17930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1789127613.461359:0:17930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458854a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:284dec05-5462-486c-a9c6-26bee181b930+14:2402:x1876035771694848:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127613.461372:0:17930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127613.461378:0:17930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff93458858da00/0xd718aadfd785ec57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00007f expref: 14 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461388:0:17930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff93458858da00/0xd718aadfd785ec57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00007f expref: 14 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461414:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff93458858da00/0xd718aadfd785ec57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00007f expref: 14 pid: 17938 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461430:0:17930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127613.461430:0:17931:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789127613.461438:0:17931:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789127613.461488:0:17930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458854a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:284dec05-5462-486c-a9c6-26bee181b930+13:2402:x1876035771694848:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 130us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127613.461496:0:17930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:1.0:1789127613.461555:0:17930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:1.0:1789127613.461561:0:17930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ce580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:284dec05-5462-486c-a9c6-26bee181b930+12:2402:x1876035771694976:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127613.461569:0:17930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127613.461573:0:17930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9346b622da00/0xd718aadfd785ec18 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00000f expref: 12 pid: 17939 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461582:0:17930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9346b622da00/0xd718aadfd785ec18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00000f expref: 12 pid: 17939 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461592:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346b622da00/0xd718aadfd785ec18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00000f expref: 12 pid: 17939 timeout: 674 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461602:0:17930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461609:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461621:0:17930:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461628:0:17930:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461635:0:17930:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461641:0:17930:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461654:0:17930:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b622c800 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127613.461658:0:17930:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461667:0:17930:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461683:0:17930:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127613.461688:0:20979:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127613.461691:0:17930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127613.461695:0:20979:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127613.461701:0:20979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9346b622c800/0xd718aadfd785ec88 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20979 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127613.461710:0:17930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ce580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:284dec05-5462-486c-a9c6-26bee181b930+11:2402:x1876035771694976:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 149us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127613.461716:0:17930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000001:00100000:0.0:1789127613.756292:0:20272:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5bf94dad-08b7-4dca-adb6-c077dbc03986 00000001:00100000:3.0:1789127613.756460:0:19451:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5bf94dad-08b7-4dca-adb6-c077dbc03986 00010000:00010000:3.0:1789127614.460418:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789127614.652580:0:17942:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789127614.652610:0:17942:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff934587b44000 from 19 10000000:01000000:0.0:1789127614.652615:0:17942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127614.652658:0:17942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785ec8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.652681:0:17942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785ec8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.652692:0:17942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785ec8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127614.652716:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789608576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.652782:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127614.652819:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934588439840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127614.652838:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789608576 00000100:00100000:0.0:1789127614.652843:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789608576 00000100:00100000:0.0:1789127614.652887:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789127614.652895:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+20:17942:x1876035789608576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127614.652907:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127614.652920:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff934587fec800/0xd718aadfd785ec96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785ec8f expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.652940:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff934587fec800/0xd718aadfd785ec96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785ec8f expref: 21 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.652950:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff934587fec800/0xd718aadfd785ec96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785ec8f expref: 21 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.652958:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff934587fec800, rc 0) 00000100:00100000:0.0:1789127614.652991:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:17942:x1876035789608576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127614.653004:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789127614.653059:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789608576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127614.653072:0:17942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785ec8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ec96 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.653081:0:17942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785ec8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785ec96 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127614.653133:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789608704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.653156:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127614.653170:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934588439840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127614.653182:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789608704 00000100:00100000:0.0:1789127614.653185:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789608704 00000100:00100000:0.0:1789127614.653205:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789127614.653211:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:17942:x1876035789608704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.653307:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:17942:x1876035789608704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127614.653327:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789127614.653357:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789608704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.653381:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789608832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.653418:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127614.653432:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934588439840 going to sleep for 11 seconds 00000100:00100000:0.0:1789127614.653443:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789608832 00000100:00100000:0.0:1789127614.653446:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789608832 00000100:00100000:0.0:1789127614.653466:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789127614.653478:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:17942:x1876035789608832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.653567:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:17942:x1876035789608832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127614.653574:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789127614.653610:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789608832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789127614.654218:0:21033:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789127614.654271:0:17942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789127614.654289:0:17942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127614.654297:0:17942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785ec8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ec96 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.654306:0:17942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fed000/0xd718aadfd785ec8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ec96 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127614.654331:0:17942:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789127614.654333:0:17942:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b548a000 from 19 10000000:01000000:0.0:1789127614.654335:0:17942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127614.654357:0:17942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785ec9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.654364:0:17942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785ec9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.654372:0:17942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785ec9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127614.654388:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789608960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.654418:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127614.654445:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934588439d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127614.654459:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789608960 00000100:00100000:0.0:1789127614.654462:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789608960 00000100:00100000:0.0:1789127614.654492:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789127614.654499:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+21:17942:x1876035789608960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127614.654528:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127614.654539:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928fe400/0xd718aadfd785eca4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785ec9d expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.654557:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928fe400/0xd718aadfd785eca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785ec9d expref: 22 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.654565:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928fe400/0xd718aadfd785eca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785ec9d expref: 22 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.654572:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe400, rc 0) 00000100:00100000:0.0:1789127614.654602:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:17942:x1876035789608960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127614.654607:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789127614.654641:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789608960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127614.654653:0:17942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785ec9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785eca4 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.654660:0:17942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785ec9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785eca4 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127614.654701:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.654724:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127614.654744:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934588439d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127614.654756:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789609088 00000100:00100000:0.0:1789127614.654759:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789609088 00000100:00100000:0.0:1789127614.654781:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789127614.654787:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:17942:x1876035789609088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.654876:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:17942:x1876035789609088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127614.654883:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789127614.654914:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.654940:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.654978:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127614.654991:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934588439d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789127614.655001:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789609216 00000100:00100000:0.0:1789127614.655004:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789609216 00000100:00100000:0.0:1789127614.655024:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789127614.655030:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:17942:x1876035789609216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.655096:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:17942:x1876035789609216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 66us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127614.655103:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789127614.655139:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609216:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789127614.657965:0:21034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:0.0:1789127614.659959:0:17942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:0.0:1789127614.660054:0:17942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789127614.660065:0:17942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785ec9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785eca4 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.660077:0:17942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff934587fed200/0xd718aadfd785ec9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785eca4 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789127614.660092:0:17942:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789127614.660095:0:17942:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346c1efc000 from 19 10000000:01000000:0.0:1789127614.660158:0:17942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789127614.660192:0:17942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785ecab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.660200:0:17942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785ecab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.660279:0:17942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785ecab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127614.660376:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.660636:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127614.660717:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff93469017f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127614.660801:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789609344 00000100:00100000:1.0:1789127614.660807:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789609344 00000100:00100000:1.0:1789127614.660883:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789127614.660893:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+22:17942:x1876035789609344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789127614.660906:0:17938:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127614.660918:0:17938:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff93458858da00/0xd718aadfd785ecb2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785ecab expref: -99 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127614.660941:0:17938:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff93458858da00/0xd718aadfd785ecb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785ecab expref: 23 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127614.660950:0:17938:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff93458858da00/0xd718aadfd785ecb2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785ecab expref: 23 pid: 17938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127614.660969:0:17938:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858da00, rc 0) 00000100:00100000:1.0:1789127614.661024:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:17942:x1876035789609344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127614.661031:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789127614.661208:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127614.661290:0:17942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785ecab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ecb2 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.661299:0:17942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785ecab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785ecb2 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127614.661589:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.661621:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127614.661640:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff93469017f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127614.661755:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789609472 00000100:00100000:1.0:1789127614.661760:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789609472 00000100:00100000:1.0:1789127614.661821:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789127614.661829:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:17942:x1876035789609472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127614.661949:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:17942:x1876035789609472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127614.661957:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789127614.661991:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127614.662024:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581bf5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127614.662064:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127614.664181:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789609600 00000100:00100000:0.0:1789127614.664193:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789609600 00000100:00100000:2.0:1789127614.664214:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934688af3600 going to sleep for 11 seconds 00000100:00100000:0.0:1789127614.664241:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789127614.664249:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:17942:x1876035789609600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789127614.664801:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:17942:x1876035789609600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 550us (2734us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127614.664810:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789127614.665438:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581bf5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609600:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789127614.667411:0:21036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789127614.668052:0:17942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789127614.668077:0:17942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127614.668087:0:17942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785ecab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ecb2 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127614.668098:0:17942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346928fee00/0xd718aadfd785ecab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ecb2 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789127614.668109:0:17942:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789127614.668112:0:17942:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9346b7fe3800 from 19 10000000:01000000:2.0:1789127614.668115:0:17942:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789127614.668151:0:17942:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346b622d400/0xd718aadfd785ecb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127614.668170:0:17942:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.148@tcp lock: ffff9346b622d400/0xd718aadfd785ecb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127614.668181:0:17942:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.148@tcp lock: ffff9346b622d400/0xd718aadfd785ecb9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127614.668204:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581bf5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789127614.668276:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127614.668329:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934688af3600 going to sleep for 11 seconds 00000100:00100000:0.0:1789127614.668376:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789609728 00000100:00100000:0.0:1789127614.668384:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789609728 00000100:00100000:0.0:1789127614.668461:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789127614.668470:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+23:17942:x1876035789609728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127614.668482:0:17940:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127614.668495:0:17940:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928ff200/0xd718aadfd785ecc0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd718aadfd785ecb9 expref: -99 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.668544:0:17940:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928ff200/0xd718aadfd785ecc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd718aadfd785ecb9 expref: 24 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.668555:0:17940:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928ff200/0xd718aadfd785ecc0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd718aadfd785ecb9 expref: 24 pid: 17940 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127614.668562:0:17940:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff200, rc 0) 00000100:00100000:0.0:1789127614.668600:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:17942:x1876035789609728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127614.668607:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789127614.668684:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581bf5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789127614.668699:0:17942:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.148@tcp lock: ffff9346b622d400/0xd718aadfd785ecb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ecc0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127614.668707:0:17942:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.148@tcp lock: ffff9346b622d400/0xd718aadfd785ecb9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd718aadfd785ecc0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127614.668753:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581bf5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127614.668777:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127614.668875:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934688af3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789127614.668902:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789609856 00000100:00100000:1.0:1789127614.668907:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789609856 00000100:00100000:1.0:1789127614.668929:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789127614.668936:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:17942:x1876035789609856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789127614.669152:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:17942:x1876035789609856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127614.669159:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789127614.669229:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581bf5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127614.669253:0:17942:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581bf5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789127614.669290:0:17942:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127614.669349:0:17942:0:(client.c:2715:ptlrpc_set_wait()) set ffff934688af3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789127614.669396:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789609984 00000100:00100000:1.0:1789127614.669401:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789609984 00000100:00100000:1.0:1789127614.669466:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789127614.669474:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93468764f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:17942:x1876035789609984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127614.669576:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93468764f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:17942:x1876035789609984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 103us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127614.669592:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789127614.669658:0:17942:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581bf5680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:17942:1876035789609984:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789127614.670756:0:21038:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789127614.670912:0:17942:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789127614.670937:0:17942:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.148@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789127614.670945:0:17942:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.148@tcp lock: ffff9346b622d400/0xd718aadfd785ecb9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ecc0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127614.670954:0:17942:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.148@tcp lock: ffff9346b622d400/0xd718aadfd785ecb9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd718aadfd785ecc0 expref: -99 pid: 17942 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127615.039476:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127615.039526:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771695104 00000100:00100000:0.0:1789127615.039535:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771695104 00000100:00100000:0.0:1789127615.039582:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 157 00000100:00100000:0.0:1789127615.039591:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+11:15201:x1876035771695104:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789127615.039614:0:17939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127615.039632:0:17939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346928ffc00/0xd718aadfd785ecc7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6f0000b7 expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127615.039660:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346928ffc00/0xd718aadfd785ecc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000b7 expref: 12 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127615.039672:0:17939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346928ffc00/0xd718aadfd785ecc7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000b7 expref: 12 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127615.039683:0:17939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ffc00, rc 0) 00000100:00100000:0.0:1789127615.039751:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+12:15201:x1876035771695104:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 160us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127615.039758:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 157 00000100:00100000:1.0:1789127615.042947:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127615.043023:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771695232 00000100:00100000:2.0:1789127615.043032:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771695232 00000100:00100000:2.0:1789127615.043087:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 158 00000100:00100000:2.0:1789127615.043096:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+12:15201:x1876035771695232:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127615.043257:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+12:15201:x1876035771695232:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 161us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127615.043265:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 158 00000100:00100000:3.0:1789127615.045443:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127615.045601:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771695360 00000100:00100000:1.0:1789127615.045610:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771695360 00000100:00100000:1.0:1789127615.045662:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 159 00000100:00100000:1.0:1789127615.045672:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+12:15201:x1876035771695360:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127615.045814:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+12:15201:x1876035771695360:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 142us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127615.045823:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 159 00000100:00100000:1.0:1789127615.052931:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127615.053066:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771695488 00000100:00100000:3.0:1789127615.053076:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771695488 00000100:00100000:3.0:1789127615.053130:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 160 00000100:00100000:3.0:1789127615.053140:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+12:15201:x1876035771695488:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789127615.053155:0:17939:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127615.053172:0:17939:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9346c214de00/0xd718aadfd785ecce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x63999e8a6f0000be expref: -99 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127615.053197:0:17939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9346c214de00/0xd718aadfd785ecce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000be expref: 13 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127615.053208:0:17939:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9346c214de00/0xd718aadfd785ecce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000be expref: 13 pid: 17939 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127615.053216:0:17939:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214de00, rc 0) 00000100:00100000:3.0:1789127615.053283:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:284dec05-5462-486c-a9c6-26bee181b930+13:15201:x1876035771695488:12345-192.168.206.48@tcp:101:ll_cfg_requeue.0 Request processed in 144us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127615.053290:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 160 00000100:00100000:3.0:1789127615.055786:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127615.055896:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771695616 00000100:00100000:2.0:1789127615.055905:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771695616 00000100:00100000:2.0:1789127615.055957:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 161 00000100:00100000:2.0:1789127615.055968:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+13:15201:x1876035771695616:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789127615.056112:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:284dec05-5462-486c-a9c6-26bee181b930+13:15201:x1876035771695616:12345-192.168.206.48@tcp:501:ll_cfg_requeue.0 Request processed in 145us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127615.056121:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 161 00000100:00100000:2.0:1789127615.058890:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127615.058975:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771695744 00000100:00100000:1.0:1789127615.058984:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771695744 00000100:00100000:1.0:1789127615.059033:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 162 00000100:00100000:1.0:1789127615.059044:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+13:15201:x1876035771695744:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789127615.059168:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+13:15201:x1876035771695744:12345-192.168.206.48@tcp:503:ll_cfg_requeue.0 Request processed in 126us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127615.059177:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 162 00000100:00100000:0.0:1789127615.287717:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789610112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789127615.287784:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127615.287812:0:19459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789610112 00000100:00100000:3.0:1789127615.287829:0:19459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789610112 00000100:00100000:3.0:1789127615.287896:0:19459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789127615.287906:0:19459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692954f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789610112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789127615.287932:0:19459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789127615.287979:0:19459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692954f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789610112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127615.287986:0:19459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789127615.288007:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789127615.288038:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789610112:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127615.290272:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581bf6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789610240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127615.290388:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127615.290438:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581bf4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789610368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127615.290463:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127615.290505:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789610240 00000100:00100000:2.0:1789127615.290539:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789610240 00000100:00100000:2.0:1789127615.290576:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789610368 00000100:00100000:2.0:1789127615.290579:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789610368 00000100:00100000:2.0:1789127615.290595:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127615.290603:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789610240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127615.290628:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789127615.290666:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789610240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127615.290673:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127615.290687:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789127615.290692:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789610368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789127615.290702:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789127615.290966:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789610368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 272us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127615.290973:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789127615.290990:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789127615.290994:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127615.291023:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581bf6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789610240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127615.291054:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581bf4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789610368:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127615.292948:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789610496:0@lo:400:kworker.0 00000100:00100000:2.0:1789127615.293004:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127615.293048:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692955a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789611008:0@lo:400:kworker.0 00000100:00100000:0.0:1789127615.293070:0:17938:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789610496 00000100:00100000:2.0:1789127615.293075:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127615.293078:0:17938:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789610496 00000100:00100000:2.0:1789127615.293092:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789611520:0@lo:400:kworker.0 00000100:00100000:2.0:1789127615.293114:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127615.293116:0:17938:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789127615.293125:0:17938:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:3653:x1876035789610496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127615.293140:0:3653:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789127615.293146:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692954b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789610880:0@lo:400:kworker.0 00000100:00100000:0.0:1789127615.293165:0:17938:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:3653:x1876035789610496:12345-0@lo:400:kworker.0 Request processed in 41us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127615.293167:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127615.293173:0:17938:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789127615.293184:0:3653:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581f30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789611392:0@lo:400:kworker.0 00000100:00100000:2.0:1789127615.293203:0:3653:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127615.293231:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3653:1876035789610496:0@lo:400:kworker.0 00000100:00100000:0.0:1789127615.293234:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789611520 00000100:00100000:0.0:1789127615.293237:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789611520 00000100:00100000:0.0:1789127615.294571:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789611392 00000100:00100000:0.0:1789127615.294580:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789611392 00000100:00100000:3.0:1789127615.294632:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789127615.294643:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789611520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.294706:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3653:x1876035789611520:12345-0@lo:400:kworker.0 Request processed in 65us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127615.294713:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789127615.294729:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789127615.294735:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789611392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.294762:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3653:x1876035789611392:12345-0@lo:400:kworker.0 Request processed in 29us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127615.294768:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789127615.295590:0:20454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789611008 00000100:00100000:3.0:1789127615.295596:0:20454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789611008 00000100:00100000:2.0:1789127615.295629:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789610880 00000100:00100000:2.0:1789127615.295634:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789610880 00000100:00100000:3.0:1789127615.295635:0:20454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789127615.295641:0:20454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789611008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127615.295659:0:18689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789127615.295665:0:18689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789610880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.295681:0:20454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf4f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789611008:12345-0@lo:400:kworker.0 Request processed in 41us (2605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127615.295687:0:20454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789127615.295694:0:18689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3653:x1876035789610880:12345-0@lo:400:kworker.0 Request processed in 30us (2527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127615.295700:0:18689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789127615.295712:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692956d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789610752:0@lo:400:kworker.0 00000100:00080000:2.0:1789127615.295726:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789127615.295730:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127615.295733:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127615.295744:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127615.295758:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692954b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789610880:0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.295765:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789611264:0@lo:400:kworker.0 00010000:00080000:2.0:1789127615.295772:0:3653:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934581f30780 x1876035789611392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127615.295782:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581f30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3653:1876035789611392:0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.295783:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127615.295793:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692955a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3653:1876035789611008:0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.295800:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789127615.295803:0:3653:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581f30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3653:1876035789611520:0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.295806:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789610624:0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.295826:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127615.295843:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581f30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789611136:0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.295862:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127615.295877:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581f30b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789611648:0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.295896:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127615.295918:0:17950:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789610624 00000100:00100000:3.0:1789127615.295921:0:17950:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789610624 00000100:00100000:3.0:1789127615.295943:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789127615.295950:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789610624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.296298:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789610624:12345-0@lo:400:kworker.0 Request processed in 348us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127615.296315:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789127615.296332:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789610752 00000100:00100000:3.0:1789127615.296336:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789610752 00000100:00100000:3.0:1789127615.296350:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789611264 00000100:00100000:3.0:1789127615.296358:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789611264 00000100:00100000:3.0:1789127615.296378:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789611136 00000100:00100000:3.0:1789127615.296381:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789611136 00000100:00100000:3.0:1789127615.296391:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789611648 00000100:00100000:3.0:1789127615.296393:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789611648 00000100:00100000:3.0:1789127615.296405:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789127615.296411:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789610752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.296440:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789610752:12345-0@lo:400:kworker.0 Request processed in 29us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127615.296446:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789127615.296458:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789127615.296464:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789611264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.296488:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3651:x1876035789611264:12345-0@lo:400:kworker.0 Request processed in 24us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127615.296494:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789127615.296504:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789127615.296532:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789611136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.296557:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789611136:12345-0@lo:400:kworker.0 Request processed in 49us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127615.296563:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789127615.296573:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789127615.296578:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789611648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.296600:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789611648:12345-0@lo:400:kworker.0 Request processed in 22us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127615.296606:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789127615.296639:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692957c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789610624:0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.296657:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581f30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789611136:0@lo:400:kworker.0 00010000:00080000:3.0:1789127615.296666:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934581f30b40 x1876035789611648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127631 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789127615.296675:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581f30b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789611648:0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.296684:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692956d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789610752:0@lo:400:kworker.0 00000100:00100000:3.0:1789127615.296692:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581f33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3651:1876035789611264:0@lo:400:kworker.0 00000100:00080000:2.0:1789127615.297161:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789127615.297165:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789127615.479643:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127616.503646:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789127616.688370:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127616.688450:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771695872 00000100:00100000:3.0:1789127616.688460:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771695872 00000100:00100000:3.0:1789127616.688569:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:3.0:1789127616.688580:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690406d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:15871:x1876035771695872:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127616.688599:0:20455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127616.688620:0:20455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ecd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f0000c5 expref: -99 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688682:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecdc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688695:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688706:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688719:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ece3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688725:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ece3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688747:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ece3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688836:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d800/0xd718aadfd785ecea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688844:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d800/0xd718aadfd785ecea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688852:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d800/0xd718aadfd785ecea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127616.688880:0:20455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789127616.688885:0:20455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127616.688921:0:20455:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d800/0xd718aadfd785ecea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688932:0:20455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecdc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688938:0:20455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecdc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688944:0:20455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688950:0:20455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214c200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127616.688954:0:20455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecdc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688961:0:20455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecdc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688980:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586ef4400) 00010000:00010000:3.0:1789127616.688983:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127616.688988:0:20455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.688994:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.689006:0:20455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ece3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.689013:0:20455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ece3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.689018:0:20455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ece3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.689023:0:20455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214da00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127616.689027:0:20455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ece3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.689032:0:20455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ece3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.689040:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff934586ef4b00) 00010000:00010000:3.0:1789127616.689042:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127616.689045:0:20455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ece3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.689051:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ece3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.689092:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ecd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000c5 expref: 8 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.689105:0:20455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d800/0xd718aadfd785ecea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000c5 expref: 7 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.689112:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff934586ef4f00) 00010000:00010000:3.0:1789127616.689114:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127616.689117:0:20455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214d800, rc 0) 00000100:00100000:3.0:1789127616.689179:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690406d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:15871:x1876035771695872:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 600us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127616.689187:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00080000:0.0:1789127616.689333:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789127616.696079:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127616.696173:0:17957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771696000 00000100:00100000:0.0:1789127616.696183:0:17957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771696000 00000100:00100000:0.0:1789127616.696241:0:17957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:0.0:1789127616.696251:0:17957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:15871:x1876035771696000:12345-192.168.206.48@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789127616.696336:0:17957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:15871:x1876035771696000:12345-192.168.206.48@tcp:900:lhsmtool_posix.0 Request processed in 87us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127616.696344:0:17957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:1.0:1789127616.711088:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127616.711469:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771696256 00000100:00100000:3.0:1789127616.711479:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771696256 00000100:00100000:3.0:1789127616.711557:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:3.0:1789127616.711567:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690404780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:15871:x1876035771696256:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127616.711586:0:17947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127616.711604:0:17947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ecf1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f0000cc expref: -99 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.711676:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ecf8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.711690:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ecf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.711717:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ecf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.711888:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.711898:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.711906:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712008:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c600/0xd718aadfd785ed06 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712016:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c600/0xd718aadfd785ed06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712022:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c600/0xd718aadfd785ed06 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127616.712031:0:17947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789127616.712170:0:17947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ecf8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712178:0:17947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ecf8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712185:0:17947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ecf8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712191:0:17947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214da00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127616.712201:0:17947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ecf8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712209:0:17947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ecf8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712221:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff934586ef4f00) 00010000:00010000:3.0:1789127616.712224:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127616.712228:0:17947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ecf8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712235:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ecf8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712248:0:17947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712254:0:17947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecff lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712260:0:17947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712266:0:17947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214c200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127616.712269:0:17947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712274:0:17947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecff lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712287:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff934586ef4b00) 00010000:00010000:3.0:1789127616.712290:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127616.712311:0:17947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecff lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.712317:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ecff lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.714703:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ecf1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000cc expref: 10 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.714725:0:17947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c600/0xd718aadfd785ed06 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000cc expref: 9 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.714735:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4000) 00010000:00010000:3.0:1789127616.714738:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127616.714741:0:17947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214c600, rc 0) 00000100:00100000:3.0:1789127616.714812:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690404780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+9:15871:x1876035771696256:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 3246us (3738us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789127616.714821:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:2.0:1789127616.720921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127616.721155:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771696384 00000100:00100000:1.0:1789127616.721164:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771696384 00000100:00100000:1.0:1789127616.721219:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:1.0:1789127616.721229:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+9:15871:x1876035771696384:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789127616.721352:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+9:15871:x1876035771696384:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 Request processed in 124us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127616.721360:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:1.0:1789127616.725547:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127616.725674:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771696512 00000100:00100000:0.0:1789127616.725683:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771696512 00000100:00100000:0.0:1789127616.725762:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:0.0:1789127616.725783:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:15871:x1876035771696512:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 00000100:00080000:2.0:1789127616.728048:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1789127616.729074:0:17945:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3246us 00000100:00100000:2.0:1789127616.739921:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127616.739998:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771696640 00000100:00100000:3.0:1789127616.740008:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771696640 00000100:00100000:3.0:1789127616.740081:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:3.0:1789127616.740092:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+9:15877:x1876035771696640:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127616.740113:0:17946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127616.740134:0:17946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f0000d3 expref: -99 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740193:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740222:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740233:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740247:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740254:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740262:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740318:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740327:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed1b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740334:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740340:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214c200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127616.740345:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740353:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740366:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586ef4400) 00010000:00010000:3.0:1789127616.740375:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127616.740381:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740388:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740401:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740407:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740413:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740419:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214da00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127616.740422:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740428:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740437:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff934586ef4b00) 00010000:00010000:3.0:1789127616.740440:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127616.740442:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740447:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740719:0:17946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000d3 expref: 10 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740736:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586ef4400) 00010000:00010000:3.0:1789127616.740739:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127616.740743:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000d3 expref: 10 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.740755:0:17946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214d200, rc 0) 00000100:00100000:3.0:1789127616.740808:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+9:15877:x1876035771696640:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 718us (896us total) trans 0 rc 301/301 00000100:00100000:3.0:1789127616.740816:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:1.0:1789127616.742320:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:15871:x1876035771696512:12345-192.168.206.48@tcp:59:lhsmtool_posix.0 Request processed in 16543us (16816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127616.742333:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:2.0:1789127616.745114:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127616.745241:0:17954:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771696768 00000100:00100000:3.0:1789127616.745251:0:17954:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771696768 00000100:00100000:3.0:1789127616.745320:0:17954:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:3.0:1789127616.745331:0:17954:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+9:15877:x1876035771696768:12345-192.168.206.48@tcp:700:lfs.0 00000100:00100000:3.0:1789127616.745415:0:17954:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+9:15877:x1876035771696768:12345-192.168.206.48@tcp:700:lfs.0 Request processed in 86us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127616.745423:0:17954:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:3.0:1789127616.758664:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127616.758745:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771697024 00000100:00100000:0.0:1789127616.758754:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771697024 00000100:00100000:0.0:1789127616.758803:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 28 00000100:00100000:0.0:1789127616.758812:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+9:15877:x1876035771697024:12345-192.168.206.48@tcp:36:lfs.0 00010000:00010000:0.0:1789127616.758858:0:17947:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127616.758885:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c400/0xd718aadfd785ec42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000040 expref: 9 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.758904:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586ef4400) 00010000:00010000:0.0:1789127616.758908:0:17947:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127616.758966:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.758978:0:17947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ec81 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000b0 expref: 5 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.759002:0:17947:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.759034:0:17947:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ec81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000b0 expref: 5 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.759048:0:17947:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ec81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000b0 expref: 5 pid: 17945 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127616.759061:0:17947:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581f32580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17947:1876035789611776:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127616.759139:0:17947:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b9fea300 going to sleep for 11 seconds 00000100:00100000:0.0:1789127616.768603:0:17947:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581f32580 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17947:1876035789611776:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127616.768630:0:17947:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127616.768914:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127616.769406:0:17932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771697152 00000100:00100000:0.0:1789127616.769413:0:17932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771697152 00010000:00010000:0.0:1789127616.769462:0:17932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ec81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000b0 expref: 6 pid: 17945 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127616.769498:0:17932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:0.0:1789127616.769533:0:17932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:2402:x1876035771697152:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127616.769547:0:17932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127616.769555:0:17932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ec81 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000b0 expref: 6 pid: 17945 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.769585:0:17932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ec81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000b0 expref: 6 pid: 17945 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.769608:0:17932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ec81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000b0 expref: 6 pid: 17945 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.769623:0:17932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586ef4400) 00010000:00010000:0.0:1789127616.769633:0:17932:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.769642:0:17932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.769650:0:17932:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.769677:0:17932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789127616.769714:0:17947:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.769725:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.769753:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214ce00/0xd718aadfd785ed30 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.769773:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214ce00/0xd718aadfd785ed30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.769782:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214ce00/0xd718aadfd785ed30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789127616.769808:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789127616.769854:0:17932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840cf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5bf94dad-08b7-4dca-adb6-c077dbc03986+5:2402:x1876035771697152:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 347us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127616.769863:0:17932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00010000:00010000:3.0:1789127616.773843:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed37 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.773865:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.773878:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127616.773895:0:17947:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002388fd26 reply state 000000003cf35570 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed37 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.773906:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.773913:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff934586ef4300) 00010000:00010000:3.0:1789127616.773916:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127616.773920:0:17947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789127616.773925:0:17947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789127616.773933:0:17947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.773939:0:17947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.773946:0:17947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.773958:0:17947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127616.773963:0:17947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.773970:0:17947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.773981:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934586ef4400) 00010000:00010000:3.0:1789127616.773984:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127616.773988:0:17947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.773994:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ed29 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789127616.774012:0:17947:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002388fd26 reply state 000000003cf35570 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214ce00/0xd718aadfd785ed30 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.774021:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214ce00/0xd718aadfd785ed30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.774028:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff934586ef4b00) 00010000:00010000:3.0:1789127616.774030:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789127616.774032:0:17947:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789127616.775484:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+10:15877:x1876035771697024:12345-192.168.206.48@tcp:36:lfs.0 Request processed in 16663us (16819us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789127616.775496:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 28 00000040:00080000:1.0:1789127616.824598:0:17978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789127616.874170:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127616.875131:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771697280 00000100:00100000:0.0:1789127616.875143:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771697280 00000100:00100000:0.0:1789127616.875209:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:0.0:1789127616.875219:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+10:15885:x1876035771697280:12345-192.168.206.48@tcp:101:lctl.0 00010000:00010000:0.0:1789127616.875243:0:20455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127616.875264:0:20455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f0000da expref: -99 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.875363:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffe00/0xd718aadfd785ed45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.875377:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffe00/0xd718aadfd785ed45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.875390:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffe00/0xd718aadfd785ed45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127616.875437:0:20455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789127616.875441:0:20455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127616.875476:0:20455:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffe00/0xd718aadfd785ed45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.875501:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000da expref: 12 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.875544:0:20455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffe00/0xd718aadfd785ed45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000da expref: 11 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.875553:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934587872300) 00010000:00010000:0.0:1789127616.875556:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127616.875559:0:20455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ffe00, rc 0) 00000100:00100000:0.0:1789127616.875632:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+11:15885:x1876035771697280:12345-192.168.206.48@tcp:101:lctl.0 Request processed in 414us (1472us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127616.875641:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 29 00000100:00100000:2.0:1789127616.915622:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127616.916740:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771697408 00000100:00100000:3.0:1789127616.916751:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771697408 00000100:00100000:3.0:1789127616.916832:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:3.0:1789127616.916841:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bf94dad-08b7-4dca-adb6-c077dbc03986+5:15886:x1876035771697408:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127616.916862:0:17946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127616.916882:0:17946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed4c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f0000e1 expref: -99 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.916943:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.916957:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.916969:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127616.917008:0:17946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789127616.917013:0:17946:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789127616.917032:0:17946:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.917056:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000e1 expref: 7 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.917073:0:17946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c200/0xd718aadfd785ed53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000e1 expref: 6 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.917082:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934587872300) 00010000:00010000:3.0:1789127616.917084:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127616.917088:0:17946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214c200, rc 0) 00000100:00100000:3.0:1789127616.917153:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:15886:x1876035771697408:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 313us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127616.917168:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 30 00000100:00100000:2.0:1789127616.924142:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127616.924269:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771697536 00000100:00100000:0.0:1789127616.924279:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771697536 00000100:00100000:0.0:1789127616.924366:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:0.0:1789127616.924376:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+6:15886:x1876035771697536:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127616.924394:0:20455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127616.924412:0:20455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f0000e8 expref: -99 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.924470:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785ed61 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.924484:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785ed61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.924493:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785ed61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.924502:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785ed68 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.924527:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785ed68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.924535:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785ed68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.924857:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785ed6f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.924866:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785ed6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.924872:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785ed6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127616.924922:0:20455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789127616.924926:0:20455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127616.924951:0:20455:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785ed6f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.924963:0:20455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785ed61 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925155:0:20455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785ed61 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925161:0:20455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785ed61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925166:0:20455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fec00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127616.925171:0:20455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785ed61 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925178:0:20455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785ed61 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925189:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934587872300) 00010000:00010000:0.0:1789127616.925192:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127616.925197:0:20455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785ed61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925202:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785ed61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925214:0:20455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785ed68 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925230:0:20455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785ed68 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925235:0:20455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785ed68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925240:0:20455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127616.925243:0:20455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785ed68 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925249:0:20455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785ed68 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925257:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff934586ef4b00) 00010000:00010000:0.0:1789127616.925259:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127616.925262:0:20455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785ed68 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925268:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785ed68 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925643:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000e8 expref: 8 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925662:0:20455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785ed6f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000e8 expref: 7 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.925670:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff934586ef4300) 00010000:00010000:0.0:1789127616.925673:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789127616.925682:0:20455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe800, rc 0) 00000100:00100000:0.0:1789127616.925859:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+7:15886:x1876035771697536:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 1483us (1724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127616.925869:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 31 00000100:00100000:1.0:1789127616.931825:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127616.934136:0:17957:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771697664 00000100:00100000:0.0:1789127616.934149:0:17957:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771697664 00000100:00080000:2.0:1789127616.934279:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789127616.934418:0:17957:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:0.0:1789127616.934429:0:17957:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690406580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5bf94dad-08b7-4dca-adb6-c077dbc03986+5:15886:x1876035771697664:12345-192.168.206.48@tcp:900:lfs.0 00000100:00100000:0.0:1789127616.934530:0:17957:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690406580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5bf94dad-08b7-4dca-adb6-c077dbc03986+5:15886:x1876035771697664:12345-192.168.206.48@tcp:900:lfs.0 Request processed in 83us (2696us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127616.934538:0:17957:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1789127616.949618:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127616.949735:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771697920 00000100:00100000:0.0:1789127616.949744:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771697920 00000100:00100000:0.0:1789127616.949859:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:0.0:1789127616.949871:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bf94dad-08b7-4dca-adb6-c077dbc03986+7:15886:x1876035771697920:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127616.949895:0:17947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127616.949918:0:17947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f0000ef expref: -99 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127616.950016:0:17947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789127616.950128:0:17947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed76 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000ef expref: 9 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.950143:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934587872300) 00010000:00010000:0.0:1789127616.950146:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127616.950151:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000ef expref: 9 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.950182:0:17947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff400, rc 0) 00000100:00100000:0.0:1789127616.950246:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5bf94dad-08b7-4dca-adb6-c077dbc03986+8:15886:x1876035771697920:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 377us (638us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1789127616.950253:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 32 00000100:00100000:2.0:1789127616.956163:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127616.956320:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771698176 00000100:00100000:0.0:1789127616.956330:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771698176 00000100:00100000:0.0:1789127616.956424:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:0.0:1789127616.956435:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+8:15886:x1876035771698176:12345-192.168.206.48@tcp:36:lfs.0 00010000:00010000:0.0:1789127616.956489:0:20455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127616.956547:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785ed6f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000e8 expref: 8 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.956563:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff934586ef4300) 00010000:00010000:0.0:1789127616.956567:0:20455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127616.956588:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed84 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.956601:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.956611:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127616.956975:0:20455:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000002d9efd5a reply state 000000006494667c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed84 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.956989:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127616.957010:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff934586ef4300) 00010000:00010000:0.0:1789127616.957013:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1789127616.957016:0:20455:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789127616.957025:0:20455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789127616.957119:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+9:15886:x1876035771698176:12345-192.168.206.48@tcp:36:lfs.0 Request processed in 686us (967us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789127616.957126:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 33 00000100:00100000:1.0:1789127616.959396:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127616.959460:0:17949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771698432 00000100:00100000:3.0:1789127616.959470:0:17949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771698432 00000100:00100000:3.0:1789127616.959802:0:17949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:3.0:1789127616.959823:0:17949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bf94dad-08b7-4dca-adb6-c077dbc03986+9:15886:x1876035771698432:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1789127616.960091:0:17949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bf94dad-08b7-4dca-adb6-c077dbc03986+10:15886:x1876035771698432:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 269us (692us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789127616.960099:0:17949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:2.0:1789127616.965981:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127616.966761:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771698688 00000100:00100000:3.0:1789127616.966772:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771698688 00000100:00100000:3.0:1789127616.966835:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:3.0:1789127616.966845:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bf94dad-08b7-4dca-adb6-c077dbc03986+10:15886:x1876035771698688:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:3.0:1789127616.966868:0:17946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127616.966888:0:17946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f0000f6 expref: -99 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.966953:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ed92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.966967:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ed92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.966977:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ed92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.966988:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ed99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967012:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ed99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967020:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ed99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127616.967122:0:17946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789127616.967192:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ed92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967200:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ed92 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967206:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ed92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967213:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214dc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127616.967216:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ed92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967223:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ed92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967234:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934587872300) 00010000:00010000:3.0:1789127616.967237:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127616.967242:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ed92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967248:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ed92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967271:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ed99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967277:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ed99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967282:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ed99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967288:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214d600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127616.967291:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ed99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967308:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ed99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967315:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff934586ef4b00) 00010000:00010000:3.0:1789127616.967318:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789127616.967321:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ed99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967326:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ed99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967358:0:17946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed8b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000f6 expref: 12 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967368:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934587872300) 00010000:00010000:3.0:1789127616.967371:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127616.967382:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785ed8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000f6 expref: 12 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127616.967392:0:17946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214da00, rc 0) 00000100:00100000:3.0:1789127616.967457:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5bf94dad-08b7-4dca-adb6-c077dbc03986+11:15886:x1876035771698688:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 613us (1485us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789127616.967465:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 34 00000100:00100000:1.0:1789127616.969977:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127616.973434:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771698816 00000100:00100000:2.0:1789127616.973447:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771698816 00000100:00100000:2.0:1789127616.973533:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:2.0:1789127616.974177:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690407c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bf94dad-08b7-4dca-adb6-c077dbc03986+11:15886:x1876035771698816:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789127616.974201:0:17945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127616.974233:0:17945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eda7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f0000fd expref: -99 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127616.974332:0:17945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785edae lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127616.974346:0:17945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785edae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127616.974358:0:17945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785edae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127616.974382:0:17945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789127616.974385:0:17945:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127616.974403:0:17945:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785edae lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127616.974440:0:17945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eda7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000fd expref: 13 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127616.974457:0:17945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785edae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000fd expref: 12 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127616.974466:0:17945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff934586ef4300) 00010000:00010000:2.0:1789127616.974469:0:17945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789127616.974472:0:17945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346b622dc00, rc 0) 00000100:00100000:2.0:1789127616.974578:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690407c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5bf94dad-08b7-4dca-adb6-c077dbc03986+12:15886:x1876035771698816:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 407us (4609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127616.977617:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127616.977767:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771698944 00000100:00100000:3.0:1789127616.977776:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771698944 00000100:00100000:3.0:1789127616.977830:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:3.0:1789127616.977841:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690406940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bf94dad-08b7-4dca-adb6-c077dbc03986+13:15886:x1876035771698944:12345-192.168.206.48@tcp:37:lfs.0 00000100:00100000:2.0:1789127616.981449:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 35 00000100:00100000:1.0:1789127616.987945:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690406940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5bf94dad-08b7-4dca-adb6-c077dbc03986+12:15886:x1876035771698944:12345-192.168.206.48@tcp:37:lfs.0 Request processed in 10096us (10326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127616.987958:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:1.0:1789127616.995825:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127616.995909:0:17949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771699200 00000100:00100000:3.0:1789127616.995919:0:17949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771699200 00000100:00100000:3.0:1789127616.995982:0:17949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:3.0:1789127616.995992:0:17949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bf94dad-08b7-4dca-adb6-c077dbc03986+12:15886:x1876035771699200:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1789127616.996204:0:17949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5bf94dad-08b7-4dca-adb6-c077dbc03986+13:15886:x1876035771699200:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 212us (388us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1789127616.996212:0:17949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 4 00000100:00100000:3.0:1789127617.058053:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127617.060356:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771699328 00000100:00100000:1.0:1789127617.060369:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771699328 00000100:00100000:1.0:1789127617.060427:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:1.0:1789127617.060436:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+11:15892:x1876035771699328:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1789127617.060455:0:17946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127617.060473:0:17946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785edb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000104 expref: -99 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.060947:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785edbc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061099:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785edbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061113:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785edbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061126:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785edc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061133:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785edc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061139:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785edc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061214:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785edca lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061223:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785edca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061231:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785edca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127617.061264:0:17946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789127617.061268:0:17946:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127617.061367:0:17946:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785edca lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061380:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785edbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061397:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785edbc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061403:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785edbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061409:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127617.061413:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785edbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061421:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785edbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061432:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934587872300) 00010000:00010000:1.0:1789127617.061435:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127617.061440:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785edbc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061446:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785edbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061460:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785edc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061466:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785edc3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061471:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785edc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061870:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858dc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127617.061880:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785edc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061887:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785edc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061896:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff934586ef4b00) 00010000:00010000:1.0:1789127617.061898:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127617.061902:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785edc3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061908:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785edc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061937:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785edb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000104 expref: 13 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061950:0:17946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d200/0xd718aadfd785edca lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000104 expref: 12 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.061957:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff934586ef4300) 00010000:00010000:1.0:1789127617.061960:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789127617.061962:0:17946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858d200, rc 0) 00000100:00100000:1.0:1789127617.062045:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+12:15892:x1876035771699328:12345-192.168.206.48@tcp:101:bash.0 Request processed in 1609us (4000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127617.062054:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 36 00000100:00100000:2.0:1789127617.070854:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127617.074144:0:17956:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771699456 00000100:00100000:3.0:1789127617.074157:0:17956:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771699456 00000100:00100000:3.0:1789127617.074260:0:17956:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1789127617.074271:0:17956:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:15892:x1876035771699456:12345-192.168.206.48@tcp:900:bash.0 00000100:00100000:3.0:1789127617.074377:0:17956:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:15892:x1876035771699456:12345-192.168.206.48@tcp:900:bash.0 Request processed in 107us (3531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127617.074385:0:17956:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000040:00080000:2.0:1789127617.080836:0:18702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789127617.084208:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127617.084314:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771699712 00000100:00100000:0.0:1789127617.084324:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771699712 00000100:00100000:0.0:1789127617.084382:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:0.0:1789127617.084393:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+12:15892:x1876035771699712:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1789127617.084416:0:20455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127617.084440:0:20455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785edd1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f00010b expref: -99 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.084580:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.084594:0:20455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785edae lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000fd expref: 12 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.084604:0:20455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.084633:0:20455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785edae lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000fd expref: 12 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.084646:0:20455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785edae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000fd expref: 12 pid: 17945 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127617.084671:0:20455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581f32580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20455:1876035789611904:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127617.084748:0:20455:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b9feab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127617.088394:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127617.088672:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771699840 00000100:00100000:3.0:1789127617.088682:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771699840 00010000:00010000:3.0:1789127617.088717:0:17931:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785edae lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000fd expref: 13 pid: 17945 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127617.088755:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 16 00000100:00100000:3.0:1789127617.088764:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bf94dad-08b7-4dca-adb6-c077dbc03986+13:2402:x1876035771699840:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127617.088777:0:17931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127617.088783:0:17931:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785edae lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000fd expref: 13 pid: 17945 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127617.088796:0:17931:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785edae lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000fd expref: 13 pid: 17945 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127617.088817:0:17931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff934586ef4300) 00010000:00010000:3.0:1789127617.088822:0:17931:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127617.088832:0:17931:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127617.088840:0:17931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127617.088861:0:17931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127617.090154:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5bf94dad-08b7-4dca-adb6-c077dbc03986+13:2402:x1876035771699840:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 1383us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127617.090166:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 16 00010000:00010000:0.0:1789127617.091599:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785edae lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0000fd expref: 12 pid: 17945 timeout: 678 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127617.091622:0:20455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581f32580 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20455:1876035789611904:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127617.091646:0:20455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.091655:0:20455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.091661:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.091686:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785eddf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.091697:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785eddf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.091705:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785eddf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.092136:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785ede6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.092146:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785ede6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.092169:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785ede6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127617.092181:0:20455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789127617.092208:0:20455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.092215:0:20455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.092221:0:20455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.092227:0:20455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127617.092231:0:20455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.092237:0:20455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.092248:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff934586ef4300) 00010000:00010000:0.0:1789127617.092250:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127617.092255:0:20455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.092260:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edd8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789127617.092270:0:20455:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000a132c20f reply state 00000000fb4e3a48 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785eddf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.092291:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785eddf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.092308:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff934587872e00) 00010000:00010000:0.0:1789127617.092310:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127617.092313:0:20455:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789127617.092350:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785edd1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00010b expref: 15 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.092364:0:20455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785ede6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00010b expref: 14 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.092372:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127617.092374:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1789127617.092377:0:20455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ffa00, rc 0) 00000100:00100000:0.0:1789127617.092430:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+15:15892:x1876035771699712:12345-192.168.206.48@tcp:101:bash.0 Request processed in 8039us (8231us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1789127617.092439:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 37 00000100:00100000:3.0:1789127617.122424:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127617.122599:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771699968 00000100:00100000:0.0:1789127617.122608:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771699968 00000100:00100000:0.0:1789127617.122674:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:0.0:1789127617.122684:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+15:15892:x1876035771699968:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1789127617.122707:0:17947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127617.122726:0:17947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785edf4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000112 expref: -99 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.122788:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edfb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.122806:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.122816:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127617.122861:0:17947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789127617.122866:0:17947:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127617.122883:0:17947:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.122893:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edfb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.122915:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785edf4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000112 expref: 17 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.122932:0:17947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edfb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000112 expref: 16 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.122940:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127617.122943:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127617.122946:0:17947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe200, rc 0) 00000100:00100000:0.0:1789127617.123014:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+16:15892:x1876035771699968:12345-192.168.206.48@tcp:101:bash.0 Request processed in 331us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127617.123022:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 38 00000100:00100000:0.0:1789127617.135060:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127617.135179:0:17949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771700224 00000100:00100000:3.0:1789127617.135188:0:17949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771700224 00000100:00100000:3.0:1789127617.135238:0:17949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:3.0:1789127617.135246:0:17949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+16:15892:x1876035771700224:12345-192.168.206.48@tcp:35:bash.0 00000100:00100000:3.0:1789127617.135551:0:17949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+17:15892:x1876035771700224:12345-192.168.206.48@tcp:35:bash.0 Request processed in 304us (498us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789127617.135559:0:17949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 5 00000100:00100000:2.0:1789127617.246469:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127617.247216:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771700480 00000100:00100000:1.0:1789127617.247227:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771700480 00000100:00100000:1.0:1789127617.247360:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:1.0:1789127617.247372:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692955a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+17:15902:x1876035771700480:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:1.0:1789127617.247406:0:17945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127617.247426:0:17945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785ee02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000119 expref: -99 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127617.247553:0:17945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789127617.247886:0:17945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785ee02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000119 expref: 19 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.247912:0:17945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934587872300) 00010000:00010000:1.0:1789127617.247915:0:17945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789127617.247921:0:17945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785ee02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000119 expref: 19 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.247934:0:17945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858c600, rc 0) 00000100:00100000:1.0:1789127617.248017:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692955a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+18:15902:x1876035771700480:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 647us (1557us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1789127617.248026:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 39 00000100:00100000:3.0:1789127617.251121:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127617.251285:0:17949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771700736 00000100:00100000:2.0:1789127617.251308:0:17949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771700736 00000100:00100000:2.0:1789127617.251370:0:17949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:2.0:1789127617.251381:0:17949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+18:15902:x1876035771700736:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1789127617.251637:0:17949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+19:15902:x1876035771700736:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 257us (525us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789127617.251646:0:17949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 6 00000100:00100000:3.0:1789127617.289715:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127617.290058:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771700992 00000100:00100000:0.0:1789127617.290068:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771700992 00000100:00100000:0.0:1789127617.290199:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:0.0:1789127617.290210:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+19:15905:x1876035771700992:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127617.290232:0:17947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127617.290252:0:17947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785ee10 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000120 expref: -99 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.290368:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785ee17 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.290381:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785ee17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.290391:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785ee17 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127617.290401:0:17947:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789127617.290505:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785ee10 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000120 expref: 22 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.290655:0:17947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785ee17 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000120 expref: 21 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.290666:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127617.290670:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127617.290673:0:17947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928ff000, rc 0) 00000100:00100000:0.0:1789127617.290730:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+21:15905:x1876035771700992:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 523us (1023us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1789127617.290852:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 40 00000100:00100000:2.0:1789127617.297589:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127617.297631:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127617.297765:0:17930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771701120 00000100:00100000:1.0:1789127617.297775:0:17930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771701120 00000100:00100000:0.0:1789127617.297816:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771701248 00000100:00100000:0.0:1789127617.297828:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771701248 00000100:00100000:1.0:1789127617.297843:0:17930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 0 00000100:00100000:1.0:1789127617.297854:0:17930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692956d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+22:2402:x1876035771701120:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127617.297869:0:17930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789127617.297878:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:0.0:1789127617.297889:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692957c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+22:15905:x1876035771701248:12345-192.168.206.48@tcp:54:lfs.0 00010000:00010000:1.0:1789127617.297895:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785ee17 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000120 expref: 22 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.297913:0:17930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:1.0:1789127617.297918:0:17930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127617.297948:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee25 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.297963:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.297975:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127617.298154:0:17930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692956d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+21:2402:x1876035771701120:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 302us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127617.298162:0:17930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 0 00010000:00010000:0.0:1789127617.298383:0:20455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee25 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.298393:0:20455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee25 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.298400:0:20455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.298406:0:20455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fea00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127617.298410:0:20455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee25 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.298417:0:20455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee25 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.298427:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127617.298430:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127617.298434:0:20455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee25 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.298451:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee25 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127617.298530:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692957c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+20:15905:x1876035771701248:12345-192.168.206.48@tcp:54:lfs.0 Request processed in 621us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127617.298540:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 41 00000100:00100000:2.0:1789127617.300598:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127617.300742:0:17949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771701504 00000100:00100000:3.0:1789127617.300751:0:17949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771701504 00000100:00100000:3.0:1789127617.300808:0:17949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1789127617.300817:0:17949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692954b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+20:15905:x1876035771701504:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:3.0:1789127617.301015:0:17949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692954b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+21:15905:x1876035771701504:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 193us (420us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789127617.301023:0:17949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 7 00000100:00100000:3.0:1789127617.336910:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690407840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789612032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789127617.337013:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127617.339862:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789612032 00000100:00100000:2.0:1789127617.339874:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789612032 00000100:00100000:2.0:1789127617.339948:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789127617.339964:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789612032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789127617.340002:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00080000:1.0:1789127617.340136:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127617.343189:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3651:x1876035789612032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 3224us (6168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127617.343202:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789127617.345906:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690407840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3651:1876035789612032:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1789127617.528011:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789127617.551420:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127617.551751:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771701760 00000100:00100000:1.0:1789127617.551762:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771701760 00000100:00100000:1.0:1789127617.551837:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:1.0:1789127617.551848:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692957840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+21:15936:x1876035771701760:12345-192.168.206.48@tcp:101:cat.0 00010000:00010000:1.0:1789127617.551873:0:17946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127617.551894:0:17946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785ee2c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000127 expref: -99 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.552001:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785ee33 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.552015:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785ee33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.552027:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785ee33 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127617.552050:0:17946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789127617.552164:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785ee2c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000127 expref: 24 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.552181:0:17946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785ee33 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000127 expref: 23 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.552190:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:1.0:1789127617.552230:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127617.552234:0:17946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858dc00, rc 0) 00000100:00100000:1.0:1789127617.552303:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692957840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+23:15936:x1876035771701760:12345-192.168.206.48@tcp:101:cat.0 Request processed in 446us (881us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1789127617.552310:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 42 00000100:00100000:2.0:1789127617.557669:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127617.557712:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127617.557794:0:20981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771702144 00000100:00100000:3.0:1789127617.557802:0:20981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771702144 00000100:00100000:3.0:1789127617.557860:0:20981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:3.0:1789127617.557869:0:20981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+23:2399:x1876035771702144:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127617.557882:0:20981:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127617.557908:0:20981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785ee33 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000127 expref: 23 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127617.557925:0:20981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:3.0:1789127617.557929:0:20981:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127617.557975:0:20981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e3c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+22:2399:x1876035771702144:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 107us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127617.557983:0:20981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 1 00000100:00100000:0.0:1789127617.558660:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771702016 00000100:00100000:0.0:1789127617.558666:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771702016 00000100:00100000:0.0:1789127617.558702:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:0.0:1789127617.558709:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+22:15936:x1876035771702016:12345-192.168.206.48@tcp:35:cat.0 00000100:00100000:0.0:1789127617.558937:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+23:15936:x1876035771702016:12345-192.168.206.48@tcp:35:cat.0 Request processed in 227us (1275us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1789127617.558944:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 8 00000100:00100000:2.0:1789127617.691257:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127617.691460:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771702400 00000100:00100000:1.0:1789127617.691470:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771702400 00000100:00100000:1.0:1789127617.691601:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:1.0:1789127617.691614:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+23:15942:x1876035771702400:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:1.0:1789127617.691637:0:17945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127617.691657:0:17945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785ee41 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f00012e expref: -99 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.691756:0:17945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee48 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.691769:0:17945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.691780:0:17945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee48 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127617.691790:0:17945:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1789127617.691904:0:17945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785ee41 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00012e expref: 26 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.691921:0:17945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee48 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00012e expref: 25 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.691948:0:17945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:1.0:1789127617.691951:0:17945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127617.691954:0:17945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858d600, rc 0) 00000100:00100000:1.0:1789127617.693484:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+25:15942:x1876035771702400:12345-192.168.206.48@tcp:101:dd.0 Request processed in 1865us (2228us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1789127617.693496:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 43 00000100:00100000:2.0:1789127617.703444:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127617.703486:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127617.703600:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771702528 00000100:00100000:1.0:1789127617.703609:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771702528 00000100:00100000:1.0:1789127617.703677:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:1.0:1789127617.703688:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+25:15942:x1876035771702528:12345-192.168.206.48@tcp:101:dd.0 00010000:00010000:1.0:1789127617.703710:0:17946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127617.703729:0:17946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785ee56 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000135 expref: -99 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.703761:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785ee5d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.703773:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785ee5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.703783:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785ee5d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.703890:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785ee56 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000135 expref: 27 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.703906:0:17946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785ee5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000135 expref: 26 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.703921:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:1.0:1789127617.703924:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789127617.703927:0:17946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858ca00, rc 0) 00000100:00100000:1.0:1789127617.703994:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+26:15942:x1876035771702528:12345-192.168.206.48@tcp:101:dd.0 Request processed in 307us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127617.704001:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 44 00000100:00100000:3.0:1789127617.705145:0:17930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771702656 00000100:00100000:3.0:1789127617.705154:0:17930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771702656 00000100:00100000:3.0:1789127617.705213:0:17930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:3.0:1789127617.705223:0:17930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+26:2402:x1876035771702656:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789127617.705236:0:17930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789127617.705256:0:17930:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee48 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00012e expref: 26 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127617.705275:0:17930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:3.0:1789127617.705280:0:17930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789127617.705342:0:17930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+25:2402:x1876035771702656:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 120us (1854us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127617.705349:0:17930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 2 00000100:00100000:2.0:1789127617.711190:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127617.714674:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771702912 00000100:00100000:0.0:1789127617.714688:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771702912 00000100:00100000:0.0:1789127617.714831:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 45 00000100:00100000:0.0:1789127617.714843:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+25:15942:x1876035771702912:12345-192.168.206.48@tcp:36:dd.0 00010000:00010000:0.0:1789127617.714899:0:20455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127617.714926:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785edfb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000112 expref: 25 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.714946:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127617.714950:0:20455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127617.715248:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee64 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.715280:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.715290:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789127617.715347:0:20455:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789127617.715370:0:20455:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d1957f62 reply state 00000000e7317584 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee64 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.715382:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127617.715388:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127617.715390:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127617.715392:0:20455:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127617.715501:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+27:15942:x1876035771702912:12345-192.168.206.48@tcp:36:dd.0 Request processed in 660us (4319us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789127617.715558:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 45 00000020:00080000:0.0:1789127617.715564:0:20455:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789127617.788065:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127617.788646:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771703168 00000100:00100000:0.0:1789127617.788656:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771703168 00000100:00100000:2.0:1789127617.788823:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1789127617.788835:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+27:15942:x1876035771703168:12345-192.168.206.48@tcp:35:dd.0 00000100:00100000:2.0:1789127617.789068:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+28:15942:x1876035771703168:12345-192.168.206.48@tcp:35:dd.0 Request processed in 234us (1009us total) trans 8589934611 rc 0/0 00000100:00100000:2.0:1789127617.789077:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 9 00000100:00100000:2.0:1789127617.999263:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127617.999401:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771703296 00000100:00100000:1.0:1789127617.999412:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771703296 00000100:00100000:1.0:1789127617.999473:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:1.0:1789127617.999492:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+28:15956:x1876035771703296:12345-192.168.206.48@tcp:101:stat.0 00010000:00010000:1.0:1789127617.999541:0:17946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127617.999562:0:17946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785ee6b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f00013c expref: -99 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999622:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee72 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999636:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee72 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999648:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee72 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999659:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee79 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999665:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999689:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999772:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785ee80 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999781:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785ee80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999788:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785ee80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127617.999824:0:17946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789127617.999829:0:17946:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127617.999862:0:17946:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785ee80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999873:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785ee80 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999882:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee72 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999888:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee72 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999896:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee72 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999902:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127617.999905:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee72 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999918:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee72 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999931:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff934586ef4300) 00010000:00010000:1.0:1789127617.999934:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127617.999939:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee72 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999945:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee72 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999958:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee79 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999964:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee79 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999971:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee79 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999976:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127617.999979:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee79 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999985:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee79 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127617.999991:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff934587872e00) 00010000:00010000:1.0:1789127617.999994:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127617.999997:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee79 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.000012:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee79 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.000042:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785ee6b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00013c expref: 30 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.000055:0:17946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785ee80 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00013c expref: 29 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.000062:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:1.0:1789127618.000065:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127618.000067:0:17946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858dc00, rc 0) 00000100:00100000:1.0:1789127618.000334:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+29:15956:x1876035771703296:12345-192.168.206.48@tcp:101:stat.0 Request processed in 843us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127618.000342:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 46 00000100:00100000:0.0:1789127618.053351:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.053401:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.053439:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.053472:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.053490:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.053530:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.053555:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.053588:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771703552 00000100:00100000:0.0:1789127618.053611:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771703552 00000100:00100000:0.0:1789127618.053662:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771703936 00000100:00100000:0.0:1789127618.053664:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771703936 00000100:00100000:0.0:1789127618.053680:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771704064 00000100:00100000:0.0:1789127618.053682:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771704064 00000100:00100000:0.0:1789127618.053699:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:0.0:1789127618.053708:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:2402:x1876035771703552:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127618.053775:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f330c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:2402:x1876035771703552:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 68us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127618.053782:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:0.0:1789127618.053801:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:0.0:1789127618.053807:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+12:2402:x1876035771703936:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127618.053851:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f312c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+12:2402:x1876035771703936:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 44us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127618.053857:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:0.0:1789127618.053871:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:0.0:1789127618.053878:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+5:2402:x1876035771704064:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:0.0:1789127618.053900:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f32940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5bf94dad-08b7-4dca-adb6-c077dbc03986+5:2402:x1876035771704064:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 22us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127618.053905:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:1.0:1789127618.054010:0:17940:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771703424 00000100:00100000:1.0:1789127618.054015:0:17940:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771703424 00000100:00100000:1.0:1789127618.054051:0:17940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 164 00000100:00100000:1.0:1789127618.054058:0:17940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+13:2402:x1876035771703424:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:1.0:1789127618.054086:0:17940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:284dec05-5462-486c-a9c6-26bee181b930+13:2402:x1876035771703424:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 27us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127618.054092:0:17940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 164 00000100:00080000:1.0:1789127618.054116:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789127618.054120:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789127618.054222:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771703680 00000100:00100000:3.0:1789127618.054226:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771703680 00000100:00100000:3.0:1789127618.054266:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771703808 00000100:00100000:3.0:1789127618.054269:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771703808 00000100:00100000:3.0:1789127618.054284:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771704192 00000100:00100000:3.0:1789127618.054286:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771704192 00000100:00100000:3.0:1789127618.054315:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:3.0:1789127618.054330:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f31a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:2402:x1876035771703680:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127618.054358:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f31a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:2402:x1876035771703680:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 30us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127618.054364:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:3.0:1789127618.054376:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:3.0:1789127618.054382:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:2402:x1876035771703808:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127618.054403:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:2402:x1876035771703808:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 22us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127618.054409:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:3.0:1789127618.054418:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:3.0:1789127618.054423:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f33c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bf94dad-08b7-4dca-adb6-c077dbc03986+5:2402:x1876035771704192:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127618.054443:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f33c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bf94dad-08b7-4dca-adb6-c077dbc03986+5:2402:x1876035771704192:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 20us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127618.054449:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00080000:1.0:1789127618.054527:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789127618.054530:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789127618.066191:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127618.066321:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771704320 00000100:00100000:3.0:1789127618.066330:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771704320 00000100:00100000:3.0:1789127618.066411:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:3.0:1789127618.066421:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bf94dad-08b7-4dca-adb6-c077dbc03986+5:2402:x1876035771704320:12345-192.168.206.48@tcp:400:kworker.0 00000100:00100000:3.0:1789127618.066498:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5bf94dad-08b7-4dca-adb6-c077dbc03986+5:2402:x1876035771704320:12345-192.168.206.48@tcp:400:kworker.0 Request processed in 79us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127618.066505:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00080000:1.0:1789127618.066667:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127618.075217:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.075417:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771704576 00000100:00100000:0.0:1789127618.075426:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771704576 00000100:00100000:0.0:1789127618.075540:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 47 00000100:00100000:0.0:1789127618.075551:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+29:15963:x1876035771704576:12345-192.168.206.48@tcp:36:truncate.0 00010000:00010000:0.0:1789127618.075602:0:20455:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127618.075629:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858dc00/0xd718aadfd785ee80 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00013c expref: 29 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.075663:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127618.075668:0:20455:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:1.0:1789127618.075710:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789127618.075823:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785ee87 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.075837:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785ee87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.075847:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785ee87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789127618.075885:0:20455:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:0.0:1789127618.075907:0:20455:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004d0e3512 reply state 000000008b0ea4e7 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785ee87 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.075920:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785ee87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.075926:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127618.075929:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127618.075931:0:20455:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127618.076183:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+31:15963:x1876035771704576:12345-192.168.206.48@tcp:36:truncate.0 Request processed in 632us (972us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789127618.076191:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 47 00000020:00080000:0.0:1789127618.076195:0:20455:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:2.0:1789127618.106623:0:18702:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789127618.273375:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127618.273466:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771704704 00000100:00100000:1.0:1789127618.273487:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771704704 00000100:00100000:1.0:1789127618.273577:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:1.0:1789127618.273588:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+31:15977:x1876035771704704:12345-192.168.206.48@tcp:101:stat.0 00010000:00010000:1.0:1789127618.273610:0:17946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127618.273630:0:17946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785ee8e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000143 expref: -99 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273695:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee95 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273709:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee95 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273720:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee95 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273730:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee9c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273737:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273743:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273819:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eea3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273828:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273847:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789127618.273888:0:17946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1789127618.273892:0:17946:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789127618.273915:0:17946:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273926:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eea3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273933:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee95 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273939:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee95 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273944:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee95 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273949:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127618.273953:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee95 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273960:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee95 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273970:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff934586ef4300) 00010000:00010000:1.0:1789127618.273973:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127618.273977:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee95 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.273993:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d600/0xd718aadfd785ee95 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.274007:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee9c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.274013:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee9c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.274018:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.274022:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127618.274025:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee9c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.274030:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee9c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.274037:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff934587872e00) 00010000:00010000:1.0:1789127618.274039:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127618.274042:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee9c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.274048:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c800/0xd718aadfd785ee9c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.274073:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785ee8e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000143 expref: 33 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.274099:0:17946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eea3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000143 expref: 32 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.274106:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:1.0:1789127618.274108:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789127618.274111:0:17946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858d000, rc 0) 00000100:00100000:1.0:1789127618.274175:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f33840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+32:15977:x1876035771704704:12345-192.168.206.48@tcp:101:stat.0 Request processed in 590us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127618.274183:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 48 00000100:00100000:2.0:1789127618.359956:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff93458840c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789612160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789127618.360037:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127618.360304:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127618.360313:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934690405e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789612288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127618.360340:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789127618.360410:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789612160 00000100:00100000:1.0:1789127618.360417:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789612160 00000100:00100000:1.0:1789127618.360468:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789612288 00000100:00100000:1.0:1789127618.360472:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789612288 00000100:00100000:1.0:1789127618.360488:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789127618.360504:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789612160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789127618.360569:0:17951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789127618.360611:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789612160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127618.360619:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789127618.360635:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789127618.360641:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789612288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789127618.360656:0:17951:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789127618.360680:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789612288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 39us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127618.360686:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789127618.361002:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934690405e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789612288:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789127618.361015:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff93458840c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789612160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789127618.378412:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.378574:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771704960 00000100:00100000:0.0:1789127618.378586:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771704960 00000100:00100000:0.0:1789127618.378656:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:0.0:1789127618.378667:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+32:15987:x1876035771704960:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:0.0:1789127618.378704:0:20455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127618.378725:0:20455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785eeaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f00014a expref: -99 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127618.378834:0:20455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789127618.378930:0:20455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785eeaa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00014a expref: 34 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.378943:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934587872300) 00010000:00010000:0.0:1789127618.378946:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789127618.378950:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785eeaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00014a expref: 34 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.378978:0:20455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe200, rc 0) 00000100:00100000:0.0:1789127618.379048:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+33:15987:x1876035771704960:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 382us (645us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1789127618.379055:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 49 00000100:00100000:3.0:1789127618.384308:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127618.384499:0:17949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771705216 00000100:00100000:2.0:1789127618.384539:0:17949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771705216 00000100:00100000:2.0:1789127618.384598:0:17949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:2.0:1789127618.384608:0:17949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+33:15987:x1876035771705216:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:2.0:1789127618.384908:0:17949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+34:15987:x1876035771705216:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 300us (623us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789127618.384917:0:17949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 10 00000100:00100000:1.0:1789127618.450692:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127618.450801:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771705472 00000100:00100000:2.0:1789127618.450810:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771705472 00000100:00100000:2.0:1789127618.450869:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:2.0:1789127618.450879:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690404f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+34:15993:x1876035771705472:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1789127618.450901:0:17946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127618.450920:0:17946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785eeb8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000151 expref: -99 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.451028:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.451042:0:17946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785ede6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00010b expref: 35 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.451068:0:17946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eea3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000143 expref: 35 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.451076:0:17946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.451108:0:17946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eea3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000143 expref: 35 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.451122:0:17946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eea3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000143 expref: 35 pid: 17946 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127618.451136:0:17946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b62e2940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17946:1876035789612416:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127618.451219:0:17946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785ede6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00010b expref: 35 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.451229:0:17946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785ede6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00010b expref: 35 pid: 20455 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127618.451237:0:17946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b62e2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17946:1876035789612544:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127618.451260:0:17946:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b72d8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127618.464853:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.464942:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127618.465069:0:17946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b62e2940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17946:1876035789612416:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127618.465081:0:17946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b62e2d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17946:1876035789612544:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127618.465103:0:17946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127618.474109:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771705728 00000100:00100000:1.0:1789127618.474124:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771705728 00010000:00010000:1.0:1789127618.474192:0:17931:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785ede6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00010b expref: 36 pid: 20455 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127618.474241:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771705600 00000100:00100000:1.0:1789127618.474244:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771705600 00010000:00010000:1.0:1789127618.474257:0:17931:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eea3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000143 expref: 37 pid: 17946 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127618.474297:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:1.0:1789127618.474307:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458854b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+37:2401:x1876035771705728:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127618.474323:0:17931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127618.474330:0:17931:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785ede6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00010b expref: 37 pid: 20455 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.474341:0:17931:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785ede6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00010b expref: 37 pid: 20455 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.474362:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785ede6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00010b expref: 37 pid: 20455 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.474377:0:17931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:1.0:1789127618.474382:0:17931:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.474391:0:17931:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.474414:0:17931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127618.474474:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458854b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+36:2401:x1876035771705728:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 168us (9630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127618.474481:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 17 00000100:00100000:1.0:1789127618.474552:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 18 00000100:00100000:1.0:1789127618.474558:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f31e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+35:2401:x1876035771705600:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127618.474566:0:17931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127618.474571:0:17931:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eea3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000143 expref: 35 pid: 17946 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.474580:0:17931:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eea3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000143 expref: 35 pid: 17946 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.474592:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eea3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000143 expref: 35 pid: 17946 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.474603:0:17931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:1.0:1789127618.474606:0:17931:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.474613:0:17931:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.474620:0:17931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.474640:0:17931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127618.474666:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f31e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+34:2401:x1876035771705600:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 107us (9723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127618.474673:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 18 00010000:00010000:2.0:1789127618.475242:0:17946:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.475252:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127618.475269:0:17946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1789127618.475394:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785eeb8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000151 expref: 35 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.475408:0:17946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000151 expref: 34 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.475415:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:2.0:1789127618.475418:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789127618.475420:0:17946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346b622c400, rc 0) 00000100:00100000:2.0:1789127618.475450:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690404f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+34:15993:x1876035771705472:12345-192.168.206.48@tcp:101:bash.0 Request processed in 24573us (24768us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1789127618.475457:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 50 00000100:00100000:3.0:1789127618.486277:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.497500:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771705984 00000100:00100000:0.0:1789127618.497539:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771705984 00000100:00100000:0.0:1789127618.497836:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 51 00000100:00100000:0.0:1789127618.497847:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+34:15993:x1876035771705984:12345-192.168.206.48@tcp:36:bash.0 00010000:00010000:0.0:1789127618.498054:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785eecd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.498073:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785eecd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.498101:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785eecd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789127618.498144:0:20455:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:0.0:1789127618.498165:0:20455:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000928579fc reply state 000000009ef935c1 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785eecd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.498177:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785eecd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.498185:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127618.498187:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789127618.498190:0:20455:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127618.498285:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+37:15993:x1876035771705984:12345-192.168.206.48@tcp:36:bash.0 Request processed in 440us (12016us total) trans 8589934618 rc 0/0 00000100:00100000:0.0:1789127618.498307:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 51 00000020:00080000:0.0:1789127618.498312:0:20455:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789127618.506602:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127618.506707:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771706112 00000100:00100000:1.0:1789127618.506716:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771706112 00000100:00100000:1.0:1789127618.506776:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:1.0:1789127618.506786:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+37:15993:x1876035771706112:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:1.0:1789127618.506810:0:17945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789127618.506830:0:17945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eed4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000158 expref: -99 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.506890:0:17945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eed4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000158 expref: 38 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.506904:0:17945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eed4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000158 expref: 38 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.506921:0:17945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:1.0:1789127618.506924:0:17945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789127618.506927:0:17945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff93458858d000, rc 0) 00000100:00100000:1.0:1789127618.506984:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f303c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+38:15993:x1876035771706112:12345-192.168.206.48@tcp:101:bash.0 Request processed in 199us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127618.506990:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 52 00000100:00100000:1.0:1789127618.512967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.513052:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771706240 00000100:00100000:0.0:1789127618.513062:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771706240 00000100:00100000:0.0:1789127618.513119:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:0.0:1789127618.513129:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+38:15993:x1876035771706240:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:0.0:1789127618.513147:0:20455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789127618.513167:0:20455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785eedb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f00015f expref: -99 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.513247:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785eee2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.513280:0:20455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000151 expref: 39 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.513298:0:20455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785eee2 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.513333:0:20455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000151 expref: 39 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.513404:0:20455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000151 expref: 39 pid: 17946 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127618.513420:0:20455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581f31680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20455:1876035789612672:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127618.513495:0:20455:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685179b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789127618.521442:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127618.521805:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771706368 00000100:00100000:1.0:1789127618.521813:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771706368 00010000:00010000:1.0:1789127618.521855:0:17931:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000151 expref: 40 pid: 17946 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127618.521862:0:20455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581f31680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:20455:1876035789612672:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127618.521883:0:20455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785eee2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127618.521908:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 19 00000100:00100000:1.0:1789127618.521917:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+40:2402:x1876035771706368:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127618.521932:0:17931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127618.521939:0:17931:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000151 expref: 40 pid: 17946 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.521951:0:17931:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000151 expref: 40 pid: 17946 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.521982:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785eebf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000151 expref: 40 pid: 17946 timeout: 679 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.521996:0:17931:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:1.0:1789127618.522001:0:17931:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785eee2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.522010:0:17931:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785eee2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.522026:0:17931:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785eee2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.522052:0:17931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789127618.522081:0:20455:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785eee2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.522088:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785eee2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127618.522105:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+39:2402:x1876035771706368:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 189us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127618.522112:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 19 00000004:00200000:0.0:1789127618.522138:0:20455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789127618.522143:0:20455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127618.522162:0:20455:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785eee2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.522201:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe800/0xd718aadfd785eedb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00015f expref: 39 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.522216:0:20455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785eee2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00015f expref: 38 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.522224:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127618.522226:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789127618.522229:0:20455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346928fe600, rc 0) 00000100:00100000:0.0:1789127618.522253:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+38:15993:x1876035771706240:12345-192.168.206.48@tcp:101:bash.0 Request processed in 9127us (9297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127618.522259:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 53 00000100:00100000:1.0:1789127618.527946:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127618.530192:0:17932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771706624 00000100:00100000:2.0:1789127618.530205:0:17932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771706624 00000100:00100000:2.0:1789127618.530277:0:17932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:2.0:1789127618.530298:0:17932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+38:15993:x1876035771706624:12345-192.168.206.48@tcp:103:bash.0 00010000:00010000:2.0:1789127618.530313:0:17932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789127618.530340:0:17932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785eed4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000158 expref: 38 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.530389:0:17932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785eee2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00015f expref: 37 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.530399:0:17932:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:2.0:1789127618.530404:0:17932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127618.530478:0:17932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904061c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+36:15993:x1876035771706624:12345-192.168.206.48@tcp:103:bash.0 Request processed in 191us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127618.530486:0:17932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 3 00000100:00100000:2.0:1789127618.532875:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127618.532930:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771706752 00000100:00100000:1.0:1789127618.532939:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771706752 00000100:00100000:1.0:1789127618.532994:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:1.0:1789127618.533004:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+36:15993:x1876035771706752:12345-192.168.206.48@tcp:58:bash.0 00010000:00010000:1.0:1789127618.533173:0:17945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785eee9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.533189:0:17945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785eee9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.533199:0:17945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785eee9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789127618.536216:0:17945:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789127618.537598:0:17945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1789127618.537881:0:17945:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1789127618.538055:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+36:15993:x1876035771706752:12345-192.168.206.48@tcp:58:bash.0 Request processed in 5047us (5181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127618.538066:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 54 00000100:00100000:1.0:1789127618.544798:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127618.544892:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771706880 00000100:00100000:3.0:1789127618.544902:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771706880 00000100:00100000:3.0:1789127618.544967:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 55 00000100:00100000:3.0:1789127618.544977:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690405680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+36:15993:x1876035771706880:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:3.0:1789127618.544996:0:17947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127618.545014:0:17947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785eef0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000166 expref: -99 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.545850:0:17947:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785eee9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.545862:0:17947:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785eef0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000166 expref: 37 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.545881:0:17947:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785eee9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.545895:0:17947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785eef0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000166 expref: 37 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.545907:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:2.0:1789127618.545909:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789127618.545913:0:17947:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785eef0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000166 expref: 37 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.545921:0:17947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214da00, rc 0) 00000100:00100000:2.0:1789127618.546007:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690405680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+37:15993:x1876035771706880:12345-192.168.206.48@tcp:101:bash.0 Request processed in 1030us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127618.546015:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 55 00010000:00010000:1.0:1789127618.554264:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789127618.872657:0:17978:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789127618.872676:0:17978:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789127618.872717:0:17978:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1789127618.872724:0:17978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1789127618.872845:0:17978:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346904070c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17978:1876035789612800:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789127618.872927:0:17978:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1879600 going to sleep for 11 seconds 00000100:00100000:0.0:1789127618.881441:0:17978:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346904070c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17978:1876035789612800:192.168.206.48@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789127618.881958:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127618.882095:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771707008 00000100:00100000:3.0:1789127618.882103:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771707008 00000100:00100000:3.0:1789127618.882155:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:3.0:1789127618.882165:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690405a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+37:15994:x1876035771707008:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789127618.882195:0:17946:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789127618.882343:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690405a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+37:15994:x1876035771707008:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 179us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127618.882352:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 56 00000100:00100000:1.0:1789127618.888037:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.889997:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771707136 00000100:00100000:0.0:1789127618.890011:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771707136 00000100:00100000:0.0:1789127618.890147:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:0.0:1789127618.890158:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+37:15994:x1876035771707136:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789127618.890228:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785eef7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890244:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785eef7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890257:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785eef7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890309:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785eefe lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890329:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785eefe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890337:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785eefe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890361:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef05 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890370:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890377:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789127618.890419:0:20455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789127618.890424:0:20455:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789127618.890438:0:20455:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890767:0:20455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785eef7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890774:0:20455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785eef7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890781:0:20455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785eef7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890786:0:20455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ffa00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127618.890790:0:20455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785eef7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890808:0:20455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785eef7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890820:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4000) 00010000:00010000:0.0:1789127618.890823:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127618.890829:0:20455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785eef7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890834:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ffa00/0xd718aadfd785eef7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890848:0:20455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785eefe lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890854:0:20455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785eefe lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890860:0:20455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785eefe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890865:0:20455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127618.890868:0:20455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785eefe lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890875:0:20455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785eefe lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890883:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff934587872c00) 00010000:00010000:0.0:1789127618.890890:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127618.890893:0:20455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785eefe lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890909:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe200/0xd718aadfd785eefe lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890926:0:20455:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef05 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.890932:0:20455:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef05 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.891009:0:20455:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.891015:0:20455:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127618.891018:0:20455:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef05 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.891024:0:20455:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef05 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.891032:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127618.891034:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127618.891108:0:20455:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef05 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.891116:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef05 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127618.891203:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+37:15994:x1876035771707136:12345-192.168.206.48@tcp:34:lhsmtool_posix.0 Request processed in 1045us (3172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127618.891212:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 57 00000100:00100000:0.0:1789127618.899534:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127618.899764:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771707392 00000100:00100000:3.0:1789127618.899775:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771707392 00000100:00100000:3.0:1789127618.899835:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:3.0:1789127618.899846:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+37:15994:x1876035771707392:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127618.899864:0:17946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127618.899884:0:17946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ef0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f00016d expref: -99 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.899995:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ef13 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.900027:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ef13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.900157:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ef13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789127618.900171:0:17946:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789127618.900245:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ef13 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.900253:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ef13 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.900260:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ef13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.900266:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214dc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127618.900270:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ef13 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.900277:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ef13 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.900299:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:3.0:1789127618.900302:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789127618.900307:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ef13 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.900313:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ef13 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.900353:0:17946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ef0c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00016d expref: 39 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.900371:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff934586ef4000) 00010000:00010000:3.0:1789127618.900373:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789127618.900377:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ef0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00016d expref: 39 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.900387:0:17946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214d600, rc 0) 00000100:00100000:3.0:1789127618.900702:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f31680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+38:15994:x1876035771707392:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 857us (1202us total) trans 8589934619 rc 301/301 00000100:00100000:3.0:1789127618.900710:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 58 00000100:00100000:1.0:1789127618.903576:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127618.903701:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771707520 00000100:00100000:2.0:1789127618.903711:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771707520 00000100:00100000:2.0:1789127618.903767:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:2.0:1789127618.903777:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690405e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+38:15994:x1876035771707520:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789127618.903810:0:17947:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789127618.903918:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690405e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+38:15994:x1876035771707520:12345-192.168.206.48@tcp:53:lhsmtool_posix.0 Request processed in 143us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127618.903927:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 59 00000100:00100000:1.0:1789127618.907724:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127618.908034:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771707776 00000100:00100000:2.0:1789127618.908044:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771707776 00000100:00100000:2.0:1789127618.908100:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:2.0:1789127618.908110:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690407840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+38:15994:x1876035771707776:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127618.908128:0:17945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127618.908147:0:17945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef21 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000174 expref: -99 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789127618.908864:0:17945:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =28 00000004:00080000:2.0:1789127618.908872:0:17945:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+28 in llog 00000004:00080000:2.0:1789127618.908892:0:17945:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789127618.909057:0:17945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622de00/0xd718aadfd785ef28 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.909072:0:17945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622de00/0xd718aadfd785ef28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.909098:0:17945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622de00/0xd718aadfd785ef28 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.909158:0:17945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef21 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000174 expref: 41 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.909174:0:17945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622de00/0xd718aadfd785ef28 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000174 expref: 40 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.909182:0:17945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9346b7264200) 00010000:00010000:2.0:1789127618.909185:0:17945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789127618.909188:0:17945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346b622de00, rc 0) 00000100:00100000:2.0:1789127618.909309:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690407840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+40:15994:x1876035771707776:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 1200us (1592us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1789127618.909317:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 60 00000100:00100000:1.0:1789127618.913034:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127618.913263:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771708032 00000100:00100000:2.0:1789127618.913271:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771708032 00000100:00100000:2.0:1789127618.913443:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:2.0:1789127618.913453:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+40:15994:x1876035771708032:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789127618.913529:0:17947:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127618.913553:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622de00/0xd718aadfd785ef28 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000174 expref: 40 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913569:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9346b7264200) 00010000:00010000:2.0:1789127618.913578:0:17947:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127618.913599:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622cc00/0xd718aadfd785ef36 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913623:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622cc00/0xd718aadfd785ef36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913634:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622cc00/0xd718aadfd785ef36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913696:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef3d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xaeaa1094 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913703:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaeaa1094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913709:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaeaa1094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913754:0:17947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622cc00/0xd718aadfd785ef36 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913760:0:17947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622cc00/0xd718aadfd785ef36 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913766:0:17947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622cc00/0xd718aadfd785ef36 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913771:0:17947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b622cc00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127618.913774:0:17947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622cc00/0xd718aadfd785ef36 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913780:0:17947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622cc00/0xd718aadfd785ef36 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913788:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff934586ef4300) 00010000:00010000:2.0:1789127618.913796:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127618.913800:0:17947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622cc00/0xd718aadfd785ef36 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913806:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622cc00/0xd718aadfd785ef36 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913817:0:17947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef3d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaeaa1094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913823:0:17947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef3d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaeaa1094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913829:0:17947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaeaa1094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913835:0:17947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b622c400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127618.913837:0:17947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef3d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaeaa1094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913844:0:17947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef3d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xaeaa1094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913852:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xaeaa1094 (ffff9346b7264500) 00010000:00010000:2.0:1789127618.913855:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127618.913857:0:17947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef3d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xaeaa1094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.913862:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef3d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xaeaa1094 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127618.914214:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690407480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+39:15994:x1876035771708032:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 760us (1186us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789127618.914228:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 61 00000100:00100000:1.0:1789127618.917083:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127618.917222:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771708160 00000100:00100000:3.0:1789127618.917232:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771708160 00000100:00100000:3.0:1789127618.917437:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:3.0:1789127618.917449:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690406940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+39:15994:x1876035771708160:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127618.917469:0:17946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127618.917503:0:17946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ef44 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f00017b expref: -99 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.917580:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ef4b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.917594:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ef4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.917605:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ef4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.917712:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ef44 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00017b expref: 41 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.917737:0:17946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214dc00/0xd718aadfd785ef4b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00017b expref: 40 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.917747:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff934586ef4400) 00010000:00010000:3.0:1789127618.917751:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789127618.917754:0:17946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214dc00, rc 0) 00000100:00100000:3.0:1789127618.917809:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690406940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+40:15994:x1876035771708160:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 362us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127618.917818:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 62 00000100:00100000:1.0:1789127618.921230:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.921773:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771708416 00000100:00100000:0.0:1789127618.921782:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771708416 00000100:00100000:0.0:1789127618.921839:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:0.0:1789127618.921849:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690404b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+40:15994:x1876035771708416:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789127618.921923:0:20455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef52 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.921938:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.921950:0:20455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789127618.922113:0:20455:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1789127618.922123:0:20455:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 580114613217ns, next at 581114610569ns, rc = 0 00000004:00010000:0.0:1789127618.922169:0:20455:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e6da5031 reply state 0000000055ba3a34 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef52 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.922182:0:20455:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.922189:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff934586ef4400) 00010000:00010000:0.0:1789127618.922192:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789127618.922196:0:20455:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789127618.922302:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690404b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+42:15994:x1876035771708416:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 454us (1080us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1789127618.922309:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 63 00000100:00100000:1.0:1789127618.925079:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127618.925173:0:17945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771708544 00000100:00100000:2.0:1789127618.925183:0:17945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771708544 00000100:00100000:2.0:1789127618.925267:0:17945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:2.0:1789127618.925278:0:17945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934690404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+42:15994:x1876035771708544:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127618.925429:0:17945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127618.925451:0:17945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef59 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000182 expref: -99 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.925644:0:17945:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000182 expref: 43 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.925661:0:17945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000182 expref: 43 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.925681:0:17945:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff934586ef4400) 00010000:00010000:2.0:1789127618.925684:0:17945:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789127618.925688:0:17945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346b622c400, rc 0) 00000100:00100000:2.0:1789127618.925789:0:17945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934690404000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+43:15994:x1876035771708544:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 513us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127618.925797:0:17945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 64 00000100:00100000:1.0:1789127618.928666:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127618.928746:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771708672 00000100:00100000:2.0:1789127618.928755:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771708672 00000100:00100000:2.0:1789127618.928812:0:19454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:2.0:1789127618.928822:0:19454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581bf43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+5:2402:x1876035771708672:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789127618.929039:0:19454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581bf43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:2402:x1876035771708672:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 219us (382us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1789127618.929060:0:19454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:1.0:1789127618.931549:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127618.931714:0:17949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771708928 00000100:00100000:2.0:1789127618.931722:0:17949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771708928 00000100:00100000:2.0:1789127618.931773:0:17949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:2.0:1789127618.931782:0:17949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+43:15994:x1876035771708928:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789127618.932031:0:17949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+44:15994:x1876035771708928:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 248us (489us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789127618.932039:0:17949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 11 00000100:00100000:1.0:1789127618.934608:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.934711:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771709184 00000100:00100000:0.0:1789127618.934720:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771709184 00000100:00100000:0.0:1789127618.934834:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:0.0:1789127618.934844:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9345878ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+44:15994:x1876035771709184:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789127618.934990:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9345878ccb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+44:15994:x1876035771709184:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 147us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127618.934998:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 65 00000100:00100000:1.0:1789127618.941119:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127618.941196:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771709312 00000100:00100000:3.0:1789127618.941206:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771709312 00000100:00100000:3.0:1789127618.941266:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:3.0:1789127618.941277:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+44:15994:x1876035771709312:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127618.941652:0:17946:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127618.941673:0:17946:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ef60 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000189 expref: -99 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.941735:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c400/0xd718aadfd785ef67 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.941749:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c400/0xd718aadfd785ef67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.941760:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c400/0xd718aadfd785ef67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127618.942847:0:17946:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789127618.942870:0:17946:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c400/0xd718aadfd785ef67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.942901:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d600/0xd718aadfd785ef60 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000189 expref: 46 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.942919:0:17946:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c400/0xd718aadfd785ef67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000189 expref: 45 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.942927:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff934586ef4400) 00010000:00010000:2.0:1789127618.942929:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789127618.942932:0:17946:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214c400, rc 0) 00000100:00100000:2.0:1789127618.943109:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+45:15994:x1876035771709312:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 1833us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127618.943118:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 66 00000100:00100000:1.0:1789127618.949459:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127618.949552:0:19455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771709440 00000100:00100000:2.0:1789127618.949561:0:19455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771709440 00000100:00100000:2.0:1789127618.949632:0:19455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:2.0:1789127618.949642:0:19455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ebf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+6:2402:x1876035771709440:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789127618.949659:0:19455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127618.949679:0:19455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6d9d69c/0xd718aadfd785ef6e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000190 expref: -99 pid: 19455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127618.949703:0:19455:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3ebc2, blocks: 0x0 00010000:00010000:2.0:1789127618.949723:0:19455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=580s v=(0 0) 00010000:00010000:2.0:1789127618.949727:0:19455:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127618.949736:0:19455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6d9d69c/0xd718aadfd785ef6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000190 expref: 7 pid: 19455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.949756:0:19455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f6d9d69c/0xd718aadfd785ef6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000190 expref: 7 pid: 19455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.949770:0:19455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346b622cc00, rc 0) 00000100:00100000:2.0:1789127618.949825:0:19455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ebf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:2402:x1876035771709440:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 185us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127618.949832:0:19455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:1.0:1789127618.955682:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127618.955771:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771709696 00000100:00100000:2.0:1789127618.955780:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771709696 00000100:00100000:2.0:1789127618.955839:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:2.0:1789127618.955848:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+45:15994:x1876035771709696:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789127618.955991:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e70f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+45:15994:x1876035771709696:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 142us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127618.956000:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 67 00000100:00100000:1.0:1789127618.961904:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.961996:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771709824 00000100:00100000:0.0:1789127618.962004:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771709824 00000100:00100000:0.0:1789127618.962058:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 68 00000100:00100000:0.0:1789127618.962067:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+45:15994:x1876035771709824:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789127618.964810:0:17925:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:0.0:1789127618.964826:0:17925:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1789127618.964884:0:17925:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1789127618.965025:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e70780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+20:15994:x1876035771709824:12345-192.168.206.48@tcp:44:lhsmtool_posix.0 Request processed in 2955us (3125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127618.965037:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 68 00010000:00010000:1.0:1789127618.965151:0:3636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed84 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.965163:0:3636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed84 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.965171:0:3636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.965176:0:3636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff400 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127618.965181:0:3636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed84 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.965189:0:3636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed84 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.965204:0:3636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff934586ef4300) 00010000:00010000:1.0:1789127618.965218:0:3636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1789127618.965224:0:3636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed84 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.965230:0:3636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff400/0xd718aadfd785ed84 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127618.967692:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b62e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789612928:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789127618.967760:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127618.968429:0:20454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789612928 00000100:00100000:2.0:1789127618.968437:0:20454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789612928 00000100:00100000:2.0:1789127618.968503:0:20454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789127618.968538:0:20454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3650:x1876035789612928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789127618.968648:0:20454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789127618.968652:0:20454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789127618.968654:0:20454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789127618.968656:0:20454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789127618 -> 1789127618 00002000:00010000:2.0:1789127618.968659:0:20454:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789127618.968707:0:20454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e712c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3650:x1876035789612928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 171us (946us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789127618.968714:0:20454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:2.0:1789127618.968754:0:3650:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9346b62e2940/2, rc 0, transno 8589934596 00000100:00100000:2.0:1789127618.968760:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b62e2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789612928:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1789127618.968915:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789127618.969464:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127618.969535:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771709952 00000100:00100000:3.0:1789127618.969552:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771709952 00000100:00100000:3.0:1789127618.969589:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:3.0:1789127618.969596:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:2401:x1876035771709952:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789127618.969659:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e73c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:2401:x1876035771709952:12345-192.168.206.48@tcp:16:lhsmtool_posix.0 Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127618.969666:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:1.0:1789127618.971902:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127618.971988:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771710208 00000100:00100000:2.0:1789127618.971997:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771710208 00000100:00100000:2.0:1789127618.972048:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:2.0:1789127618.972058:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+20:15994:x1876035771710208:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789127618.972115:0:17947:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127618.972140:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214c400/0xd718aadfd785ef67 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000189 expref: 20 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.972158:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff934586ef4400) 00010000:00010000:2.0:1789127618.972163:0:17947:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789127618.972191:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622de00/0xd718aadfd785ef75 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.972203:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622de00/0xd718aadfd785ef75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.972224:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622de00/0xd718aadfd785ef75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127618.972418:0:17947:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000922374fa reply state 00000000a2f91de6 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622de00/0xd718aadfd785ef75 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.972431:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622de00/0xd718aadfd785ef75 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.972438:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff934586ef4400) 00010000:00010000:2.0:1789127618.972441:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789127618.972443:0:17947:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789127618.972561:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e71a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+21:15994:x1876035771710208:12345-192.168.206.48@tcp:36:lhsmtool_posix.0 Request processed in 504us (666us total) trans 8589934623 rc 0/0 00000100:00100000:2.0:1789127618.972569:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 69 00000100:00100000:1.0:1789127618.974994:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127618.975684:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771710336 00000100:00100000:3.0:1789127618.975695:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771710336 00000100:00100000:3.0:1789127618.975756:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:3.0:1789127618.975767:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:15994:x1876035771710336:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789127618.975783:0:19456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789127618.975801:0:19456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fddd831d/0xd718aadfd785ef7c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f000197 expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.975829:0:19456:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f6d9d69c/0xd718aadfd785ef6e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000190 expref: 8 pid: 19455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.975838:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127618.975842:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789127618.975847:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fddd831d/0xd718aadfd785ef7c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000197 expref: 8 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.975880:0:19456:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f6d9d69c/0xd718aadfd785ef6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000190 expref: 8 pid: 19455 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127618.975894:0:19456:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f6d9d69c/0xd718aadfd785ef6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000190 expref: 8 pid: 19455 timeout: 680 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127618.975925:0:19456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:19456:1876035789613056:192.168.206.48@tcp:104: 00000100:00100000:3.0:1789127618.976002:0:19456:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684afd600 going to sleep for 11 seconds 00010000:00010000:0.0:1789127618.977264:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214ce00/0xd718aadfd785ed30 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977278:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214ce00/0xd718aadfd785ed30 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977301:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214ce00/0xd718aadfd785ed30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977307:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214ce00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127618.977311:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214ce00/0xd718aadfd785ed30 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977330:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214ce00/0xd718aadfd785ed30 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977354:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff934586ef4b00) 00010000:00010000:0.0:1789127618.977357:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127618.977363:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214ce00/0xd718aadfd785ed30 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977369:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214ce00/0xd718aadfd785ed30 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977390:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed37 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977396:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed37 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977402:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977407:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346c214d200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127618.977410:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed37 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977415:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed37 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977422:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff934586ef4300) 00010000:00010000:0.0:1789127618.977424:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127618.977427:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed37 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977440:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214d200/0xd718aadfd785ed37 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977456:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785eddf lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977462:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785eddf lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977467:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785eddf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977472:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fec00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127618.977485:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785eddf lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977491:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785eddf lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977499:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff934587872e00) 00010000:00010000:0.0:1789127618.977501:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127618.977503:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785eddf lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977535:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fec00/0xd718aadfd785eddf lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977550:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee64 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977556:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee64 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977566:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977571:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fea00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127618.977574:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee64 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977580:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee64 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977588:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127618.977590:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127618.977592:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee64 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977598:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fea00/0xd718aadfd785ee64 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977608:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785ee87 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977613:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785ee87 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977618:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785ee87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977622:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127618.977625:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785ee87 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977642:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785ee87 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977649:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127618.977651:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127618.977654:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785ee87 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977659:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff600/0xd718aadfd785ee87 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977670:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785eecd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977675:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785eecd lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977680:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785eecd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977685:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928ff000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127618.977688:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785eecd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977693:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785eecd lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977698:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127618.977701:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789127618.977703:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785eecd lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977717:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928ff000/0xd718aadfd785eecd lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977729:0:3637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef52 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977734:0:3637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef52 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977740:0:3637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977745:0:3637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:0.0:1789127618.977748:0:3637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef52 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977754:0:3637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef52 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977762:0:3637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff934586ef4400) 00010000:00010000:0.0:1789127618.977764:0:3637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789127618.977767:0:3637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef52 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.977772:0:3637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346928fe600/0xd718aadfd785ef52 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 20455 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127618.984107:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127618.984218:0:19456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee7c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:19456:1876035789613056:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127618.984248:0:19456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fddd831d/0xd718aadfd785ef7c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000197 expref: 8 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127618.984267:0:19456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346c214d600, rc 0) 00000100:00100000:2.0:1789127618.984452:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e71680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+8:15994:x1876035771710336:12345-192.168.206.48@tcp:101:lhsmtool_posix.0 Request processed in 8687us (9465us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127618.984462:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 24 00000100:00100000:1.0:1789127618.984830:0:17931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771710464 00000100:00100000:1.0:1789127618.984837:0:17931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771710464 00010000:00010000:1.0:1789127618.984869:0:17931:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f6d9d69c/0xd718aadfd785ef6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000190 expref: 8 pid: 19455 timeout: 680 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127618.984906:0:17931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:1.0:1789127618.984915:0:17931:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+8:2401:x1876035771710464:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789127618.984927:0:17931:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789127618.984944:0:17931:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f6d9d69c/0xd718aadfd785ef6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000190 expref: 8 pid: 19455 timeout: 680 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.984957:0:17931:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f6d9d69c/0xd718aadfd785ef6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000190 expref: 8 pid: 19455 timeout: 680 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.984978:0:17931:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6d9d69c/0xd718aadfd785ef6e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000190 expref: 8 pid: 19455 timeout: 680 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.985003:0:17931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127618.985008:0:17931:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789127618.985015:0:17931:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fddd831d/0xd718aadfd785ef7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000197 expref: 7 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.985025:0:17931:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fddd831d/0xd718aadfd785ef7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000197 expref: 7 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.985058:0:17931:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000fddd831d/0xd718aadfd785ef7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000197 expref: 7 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127618.985071:0:17931:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e703c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17931:1876035789613184:192.168.206.48@tcp:105: 00000100:00100000:1.0:1789127618.985120:0:17931:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346b1879600 going to sleep for 11 seconds 00000100:00100000:1.0:1789127618.991346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.991549:0:19454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771710592 00000100:00100000:0.0:1789127618.991560:0:19454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771710592 00000100:00100000:0.0:1789127618.991624:0:19454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:0.0:1789127618.991635:0:19454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+8:2401:x1876035771710592:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789127618.991786:0:19454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789127618.991790:0:19454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789127617 00002000:00010000:0.0:1789127618.991792:0:19454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789127616 00002000:00010000:0.0:1789127618.991794:0:19454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1789127618 -> 1789127617 00002000:00010000:0.0:1789127618.991796:0:19454:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789127618.991843:0:19454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+9:2401:x1876035771710592:12345-192.168.206.48@tcp:2:lhsmtool_posix.0 Request processed in 210us (515us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789127618.991851:0:19454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 25 00000100:00100000:3.0:1789127618.994031:0:17931:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e703c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:17931:1876035789613184:192.168.206.48@tcp:105: 00010000:00010000:3.0:1789127618.994058:0:17931:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789127618.994356:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127618.994444:0:19455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771710720 00000100:00100000:3.0:1789127618.994452:0:19455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771710720 00000100:00100000:0.0:1789127618.994574:0:20454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:0.0:1789127618.994585:0:20454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b93b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+9:2401:x1876035771710720:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789127618.994627:0:20454:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785ef83 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.994647:0:20454:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fddd831d/0xd718aadfd785ef7c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000197 expref: 9 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.994655:0:20454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789127618.994660:0:20454:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127618.994664:0:20454:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785ef83 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.994697:0:20454:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fddd831d/0xd718aadfd785ef7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000197 expref: 9 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.994710:0:20454:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fddd831d/0xd718aadfd785ef7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000197 expref: 9 pid: 19456 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127618.994755:0:20454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581f32d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20454:1876035789613312:192.168.206.48@tcp:104: 00000100:00100000:0.0:1789127618.994836:0:20454:0:(client.c:2715:ptlrpc_set_wait()) set ffff934685179b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789127618.996787:0:20454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581f32d00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:20454:1876035789613312:192.168.206.48@tcp:104: 00010000:00010000:0.0:1789127618.996811:0:20454:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785ef83 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127618.997789:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127618.997866:0:17932:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771710848 00000100:00100000:0.0:1789127618.997874:0:17932:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771710848 00010000:00010000:0.0:1789127618.997904:0:17932:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fddd831d/0xd718aadfd785ef7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000197 expref: 10 pid: 19456 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127618.997968:0:17932:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 21 00000100:00100000:0.0:1789127618.997977:0:17932:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+10:2401:x1876035771710848:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127618.997991:0:17932:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127618.998012:0:17932:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fddd831d/0xd718aadfd785ef7c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000197 expref: 10 pid: 19456 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.998024:0:17932:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fddd831d/0xd718aadfd785ef7c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000197 expref: 10 pid: 19456 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.998046:0:17932:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fddd831d/0xd718aadfd785ef7c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000197 expref: 10 pid: 19456 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.998082:0:17932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127618.998086:0:17932:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789127618.998091:0:17932:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785ef83 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.998100:0:17932:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785ef83 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 20454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127618.998134:0:17932:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127618.998183:0:17932:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e721c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+9:2401:x1876035771710848:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 206us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127618.998190:0:17932:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 21 00010000:00010000:1.0:1789127618.998358:0:20454:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785ef83 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.998367:0:20454:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785ef83 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.998387:0:20454:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785ef83 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.998409:0:20454:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785ef83 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.998418:0:20454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785ef83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.998426:0:20454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346928fe600 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127618.998430:0:20454:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785ef83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.998439:0:20454:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785ef83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.998452:0:20454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785ef83 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127618.998460:0:20454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9bb1dc6/0xd718aadfd785ef83 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20454 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127618.998574:0:20454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b93b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+8:2401:x1876035771710720:12345-192.168.206.48@tcp:1:lhsmtool_posix.0 Request processed in 3990us (4219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127618.998583:0:20454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 26 00000100:00100000:2.0:1789127619.000580:0:17931:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee4780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:2401:x1876035771710464:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 15658us (16473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127619.000592:0:17931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 20 00000100:00100000:0.0:1789127619.002667:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127619.002751:0:17946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771711104 00000100:00100000:2.0:1789127619.002761:0:17946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771711104 00000100:00100000:2.0:1789127619.002819:0:17946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 70 00000100:00100000:2.0:1789127619.002829:0:17946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+15:15994:x1876035771711104:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789127619.002916:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.002933:0:17946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785ee5d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000135 expref: 15 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.002942:0:17946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.002976:0:17946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785ee5d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000135 expref: 15 pid: 17946 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.002990:0:17946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785ee5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000135 expref: 15 pid: 17946 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127619.003004:0:17946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b62e2580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17946:1876035789613440:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127619.003078:0:17946:0:(client.c:2715:ptlrpc_set_wait()) set ffff934691347e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789127619.007163:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:0.0:1789127619.007248:0:17930:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771711232 00000100:00100000:0.0:1789127619.007257:0:17930:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771711232 00010000:00010000:0.0:1789127619.007311:0:17930:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785ee5d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000135 expref: 16 pid: 17946 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789127619.007364:0:17930:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 22 00000100:00100000:0.0:1789127619.007374:0:17930:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587e712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+16:2402:x1876035771711232:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789127619.007390:0:17930:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789127619.007397:0:17930:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785ee5d lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000135 expref: 16 pid: 17946 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127619.007410:0:17930:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785ee5d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000135 expref: 16 pid: 17946 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127619.007448:0:17930:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:0.0:1789127619.007454:0:17930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785eef0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000166 expref: 16 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127619.007464:0:17930:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127619.007472:0:17930:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127619.007489:0:17930:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789127619.007542:0:17930:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789127619.007587:0:17930:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587e712c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+16:2402:x1876035771711232:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 214us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127619.007595:0:17930:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 22 00010000:00010000:2.0:1789127619.008252:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858ca00/0xd718aadfd785ee5d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000135 expref: 15 pid: 17946 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127619.008269:0:17946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b62e2580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17946:1876035789613440:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127619.008302:0:17946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.008324:0:17946:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.008330:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.008562:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.008575:0:17946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef59 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000182 expref: 15 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.008582:0:17946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.008610:0:17946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000182 expref: 15 pid: 17945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.008624:0:17946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef59 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000182 expref: 15 pid: 17945 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127619.008636:0:17946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b62e2580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17946:1876035789613568:192.168.206.48@tcp:104: 00000100:00100000:2.0:1789127619.008703:0:17946:0:(client.c:2715:ptlrpc_set_wait()) set ffff9346a6bebe40 going to sleep for 11 seconds 00000100:00100000:2.0:1789127619.012026:0:17946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b62e2580 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17946:1876035789613568:192.168.206.48@tcp:104: 00010000:00010000:2.0:1789127619.012052:0:17946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127619.013450:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127619.013669:0:20981:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771711360 00000100:00100000:2.0:1789127619.013693:0:20981:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771711360 00010000:00010000:2.0:1789127619.013731:0:20981:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef59 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000182 expref: 16 pid: 17945 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127619.013778:0:20981:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 23 00000100:00100000:2.0:1789127619.013787:0:20981:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458854bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+16:2401:x1876035771711360:12345-192.168.206.48@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789127619.013802:0:20981:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789127619.013808:0:20981:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef59 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000182 expref: 16 pid: 17945 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.013822:0:20981:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef59 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000182 expref: 16 pid: 17945 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.013845:0:20981:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c400/0xd718aadfd785ef59 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000182 expref: 16 pid: 17945 timeout: 680 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.013859:0:20981:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff934586ef4400) 00010000:00010000:2.0:1789127619.013864:0:20981:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.013873:0:20981:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.013881:0:20981:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.013907:0:20981:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789127619.013976:0:20981:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458854bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+15:2401:x1876035771711360:12345-192.168.206.48@tcp:103:ldlm_bl.0 Request processed in 190us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127619.013992:0:20981:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 23 00010000:00010000:3.0:1789127619.014257:0:17946:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.014268:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789127619.014426:0:17946:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:3.0:1789127619.015031:0:17946:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1789127619.015072:0:17946:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1789127619.015149:0:17946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17946:1876035789613696:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789127619.015203:0:17946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127619.015642:0:17946:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684afd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789127619.016930:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789613696 00000100:00100000:1.0:1789127619.016940:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789613696 00000100:00100000:1.0:1789127619.017064:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789127619.017074:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934587ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17946:x1876035789613696:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789127619.017192:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934587ee7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17946:x1876035789613696:12345-0@lo:1000:mdt00_001.0 Request processed in 120us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789127619.017199:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789127619.017269:0:17946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17946:1876035789613696:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789127619.017446:0:17946:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:3.0:1789127619.017763:0:17946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17946:1876035789613824:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789127619.017821:0:17946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789127619.018638:0:17946:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684afd600 going to sleep for 11 seconds 00000100:00100000:2.0:1789127619.018820:0:18689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789613824 00000100:00100000:2.0:1789127619.018827:0:18689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789613824 00000100:00100000:0.0:1789127619.018883:0:17950:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789127619.018894:0:17950:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346a5388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17946:x1876035789613824:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789127619.019061:0:17950:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346a5388f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17946:x1876035789613824:12345-0@lo:1000:mdt00_001.0 Request processed in 169us (1240us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789127619.019069:0:17950:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789127619.019198:0:17946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587ee4780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17946:1876035789613824:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789127619.019249:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019260:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019267:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019272:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b622d800 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127619.019276:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019297:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019314:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff934586ef4400) 00010000:00010000:3.0:1789127619.019317:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127619.019321:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019327:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d800/0xd718aadfd785ef91 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019358:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785eee9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019365:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785eee9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019371:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785eee9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019387:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858c600 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:3.0:1789127619.019390:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785eee9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019397:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785eee9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019405:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:3.0:1789127619.019408:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789127619.019415:0:17946:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785eef0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000166 expref: 18 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019424:0:17946:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785eef0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000166 expref: 18 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019433:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785eef0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000166 expref: 18 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.019494:0:17946:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9346c214da00/0xd718aadfd785eef0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f000166 expref: 18 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789127619.019538:0:17946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692920780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17946:1876035789613952:192.168.206.48@tcp:105: 00000100:00100000:3.0:1789127619.019596:0:17946:0:(client.c:2715:ptlrpc_set_wait()) set ffff934684afd600 going to sleep for 11 seconds 00000100:00100000:0.0:1789127619.023360:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127619.023464:0:17946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692920780 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17946:1876035789613952:192.168.206.48@tcp:105: 00010000:00010000:1.0:1789127619.023538:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785eee9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023550:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858c600/0xd718aadfd785eee9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17945 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023583:0:17946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785ef98 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023598:0:17946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785ef98 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023611:0:17946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785ef98 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023622:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785ef98 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023629:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785ef98 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023635:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785ef98 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023640:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93458858d000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127619.023660:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785ef98 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023669:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785ef98 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023681:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:1.0:1789127619.023685:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789127619.023688:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785ef98 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023695:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93458858d000/0xd718aadfd785ef98 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023707:0:17946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023713:0:17946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023719:0:17946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023723:0:17946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b622c000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:1.0:1789127619.023725:0:17946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023731:0:17946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023737:0:17946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:1.0:1789127619.023738:0:17946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789127619.023747:0:17946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.023753:0:17946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c000/0xd718aadfd785ef8a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789127619.023926:0:17946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f32d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+18:15994:x1876035771711104:12345-192.168.206.48@tcp:57:lhsmtool_posix.0 Request processed in 21096us (21266us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1789127619.023936:0:17946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 70 00000020:00080000:1.0:1789127619.023942:0:17946:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789127619.024255:0:17978:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789127619.024260:0:17978:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789127619.024276:0:17978:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789127619.024282:0:17978:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789127619.026947:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:3.0:1789127619.027098:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771711488 00000100:00100000:3.0:1789127619.027109:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771711488 00000100:00100000:3.0:1789127619.027159:0:17948:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771711744 00000100:00100000:3.0:1789127619.027163:0:17948:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771711744 00000100:00100000:3.0:1789127619.027188:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:3.0:1789127619.027219:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+19:15993:x1876035771711488:12345-192.168.206.48@tcp:49:bash.0 00000100:00100000:3.0:1789127619.027425:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f31e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+19:15993:x1876035771711488:12345-192.168.206.48@tcp:49:bash.0 Request processed in 211us (4073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127619.027433:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 12 00000100:00100000:3.0:1789127619.027457:0:17948:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 13 00000100:00100000:3.0:1789127619.027463:0:17948:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+18:15994:x1876035771711744:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789127619.027823:0:17948:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789127619.027853:0:17948:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1789127619.027885:0:17948:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785ef9f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.027899:0:17948:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785ef9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.027910:0:17948:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785ef9f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.027920:0:17948:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785ef9f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.027926:0:17948:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785ef9f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.027931:0:17948:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785ef9f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789127619.028074:0:17948:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789127619.028135:0:17948:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f31a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+20:15994:x1876035771711744:12345-192.168.206.48@tcp:35:lhsmtool_posix.0 Request processed in 669us (1195us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1789127619.028159:0:17948:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 13 00000020:00080000:3.0:1789127619.028165:0:17948:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789127619.031421:0:17934:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789127619.031434:0:17934:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785ef9f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.031444:0:17934:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff93468501b400 already unused, calling callback (ffffffffc0e3b550) 00010000:00010000:1.0:1789127619.031448:0:17934:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785ef9f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.031457:0:17934:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785ef9f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.031474:0:17934:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff934586ef4400) 00010000:00010000:1.0:1789127619.031609:0:17934:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789127619.031617:0:17934:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785ef9f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.031624:0:17934:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff93468501b400/0xd718aadfd785ef9f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17948 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789127619.031642:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127619.031644:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789127619.031646:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127619.032301:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127619.032460:0:19456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771711872 00000100:00100000:2.0:1789127619.032469:0:19456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771711872 00000100:00100000:2.0:1789127619.032572:0:19456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:2.0:1789127619.032583:0:19456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+7:15993:x1876035771711872:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1789127619.032599:0:19456:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127619.032618:0:19456:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eeaca804/0xd718aadfd785efa6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f00019e expref: -99 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789127619.032639:0:19456:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa3ebc1, atime: 0x6aa3ebc0, ctime: 0x6aa3ebc1, blocks: 0x0 00010000:00010000:2.0:1789127619.032659:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=580s v=(0 0) 00010000:00010000:2.0:1789127619.032664:0:19456:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789127619.032674:0:19456:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eeaca804/0xd718aadfd785efa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00019e expref: 8 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.032689:0:19456:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eeaca804/0xd718aadfd785efa6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f00019e expref: 8 pid: 19456 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.032700:0:19456:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346b622c400, rc 0) 00000100:00100000:2.0:1789127619.032762:0:19456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f321c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+8:15993:x1876035771711872:12345-192.168.206.48@tcp:101:bash.0 Request processed in 182us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127619.032769:0:19456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 27 00000100:00100000:0.0:1789127619.036330:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127619.036500:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771712000 00000100:00100000:2.0:1789127619.036559:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771712000 00000100:00100000:2.0:1789127619.036651:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:2.0:1789127619.036665:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+20:15993:x1876035771712000:12345-192.168.206.48@tcp:101:bash.0 00010000:00010000:2.0:1789127619.036695:0:17947:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127619.036723:0:17947:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c600/0xd718aadfd785efad lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f0001a5 expref: -99 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.036765:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785efb4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.036781:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785efb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.036795:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785efb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.036912:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c600/0xd718aadfd785efad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0001a5 expref: 22 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.036930:0:17947:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622dc00/0xd718aadfd785efb4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0001a5 expref: 21 pid: 17947 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.036937:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:2.0:1789127619.036940:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789127619.036943:0:17947:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346b622dc00, rc 0) 00000100:00100000:2.0:1789127619.037001:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f33c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+21:15993:x1876035771712000:12345-192.168.206.48@tcp:101:bash.0 Request processed in 341us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127619.037008:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 71 00000100:00100000:0.0:1789127619.042225:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127619.042319:0:17949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771712256 00000100:00100000:1.0:1789127619.042329:0:17949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771712256 00000100:00100000:1.0:1789127619.042380:0:17949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 14 00000100:00100000:1.0:1789127619.042388:0:17949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+21:15993:x1876035771712256:12345-192.168.206.48@tcp:35:bash.0 00000001:00080000:1.0:1789127619.042657:0:17949:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:1.0:1789127619.042745:0:17949:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:1.0:1789127619.042843:0:17949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f32580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+24:15993:x1876035771712256:12345-192.168.206.48@tcp:35:bash.0 Request processed in 455us (628us total) trans 8589934633 rc 0/0 00000100:00100000:1.0:1789127619.042851:0:17949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 14 00000020:00080000:1.0:1789127619.042855:0:17949:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789127619.123109:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127619.123210:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771712512 00000100:00100000:2.0:1789127619.123220:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771712512 00000100:00100000:2.0:1789127619.123298:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:2.0:1789127619.123308:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+24:16004:x1876035771712512:12345-192.168.206.48@tcp:101:lfs.0 00010000:00010000:2.0:1789127619.123331:0:20455:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789127619.123349:0:20455:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c600/0xd718aadfd785efbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x63999e8a6f0001ac expref: -99 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789127619.123434:0:20455:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789127619.123553:0:20455:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c600/0xd718aadfd785efbb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0001ac expref: 26 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.123567:0:20455:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff934587872300) 00010000:00010000:2.0:1789127619.123570:0:20455:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789127619.123575:0:20455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622c600/0xd718aadfd785efbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.48@tcp remote: 0x63999e8a6f0001ac expref: 26 pid: 20455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.123589:0:20455:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9346b622c600, rc 0) 00000100:00100000:2.0:1789127619.123635:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+25:16004:x1876035771712512:12345-192.168.206.48@tcp:101:lfs.0 Request processed in 328us (533us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1789127619.123642:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 72 00000100:00100000:0.0:1789127619.127700:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:2.0:1789127619.127907:0:17947:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771712640 00000100:00100000:2.0:1789127619.127916:0:17947:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771712640 00000100:00100000:2.0:1789127619.127980:0:17947:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:2.0:1789127619.127991:0:17947:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+25:16004:x1876035771712640:12345-192.168.206.48@tcp:34:lfs.0 00010000:00010000:2.0:1789127619.128058:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622ce00/0xd718aadfd785efc9 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128073:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622ce00/0xd718aadfd785efc9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128096:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622ce00/0xd718aadfd785efc9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128111:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d200/0xd718aadfd785efd0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128120:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d200/0xd718aadfd785efd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128126:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d200/0xd718aadfd785efd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128192:0:17947:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d000/0xd718aadfd785efd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128202:0:17947:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d000/0xd718aadfd785efd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128209:0:17947:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d000/0xd718aadfd785efd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789127619.128248:0:17947:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d000/0xd718aadfd785efd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128260:0:17947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622ce00/0xd718aadfd785efc9 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128267:0:17947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622ce00/0xd718aadfd785efc9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128273:0:17947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622ce00/0xd718aadfd785efc9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128836:0:17947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b622ce00 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127619.128840:0:17947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622ce00/0xd718aadfd785efc9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128849:0:17947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622ce00/0xd718aadfd785efc9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128861:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff934586ef4300) 00010000:00010000:2.0:1789127619.128864:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127619.128868:0:17947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622ce00/0xd718aadfd785efc9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128874:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622ce00/0xd718aadfd785efc9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128886:0:17947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d200/0xd718aadfd785efd0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128891:0:17947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d200/0xd718aadfd785efd0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128898:0:17947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d200/0xd718aadfd785efd0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128903:0:17947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b622d200 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127619.128905:0:17947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d200/0xd718aadfd785efd0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128912:0:17947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d200/0xd718aadfd785efd0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128931:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9346b7264100) 00010000:00010000:2.0:1789127619.128933:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127619.128937:0:17947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d200/0xd718aadfd785efd0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128942:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d200/0xd718aadfd785efd0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128955:0:17947:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d000/0xd718aadfd785efd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128961:0:17947:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d000/0xd718aadfd785efd7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128966:0:17947:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d000/0xd718aadfd785efd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128972:0:17947:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9346b622d000 already unused, calling callback (ffffffffc1a7e4f0) 00010000:00010000:2.0:1789127619.128974:0:17947:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d000/0xd718aadfd785efd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128980:0:17947:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d000/0xd718aadfd785efd7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128987:0:17947:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff934587872000) 00010000:00010000:2.0:1789127619.128989:0:17947:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789127619.128992:0:17947:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d000/0xd718aadfd785efd7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789127619.128997:0:17947:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9346b622d000/0xd718aadfd785efd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17947 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789127619.129077:0:17947:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+25:16004:x1876035771712640:12345-192.168.206.48@tcp:34:lfs.0 Request processed in 1087us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127619.129091:0:17947:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 73 00000100:00100000:0.0:1789127619.139813:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-192.168.206.48@tcp (source: 12345-192.168.206.48@tcp) 00000100:00100000:1.0:1789127619.140067:0:17949:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035771712896 00000100:00100000:1.0:1789127619.140077:0:17949:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035771712896 00000100:00100000:1.0:1789127619.140130:0:17949:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.48@tcp, seq: 15 00000100:00100000:1.0:1789127619.140140:0:17949:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581f30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+25:16004:x1876035771712896:12345-192.168.206.48@tcp:35:lfs.0 00000100:00100000:1.0:1789127619.140363:0:17949:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581f30b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1a1276a5-c9a3-44c0-94fa-011bc4d17ddb+26:16004:x1876035771712896:12345-192.168.206.48@tcp:35:lfs.0 Request processed in 223us (557us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1789127619.140370:0:17949:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.48@tcp, seq: 15 00010000:00010000:3.0:1789127619.577616:0:20456:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789127620.408007:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581b85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789614464:0@lo:400:kworker.0 00000100:00100000:0.0:1789127620.408072:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127620.408102:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581b87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789614976:0@lo:400:kworker.0 00000100:00100000:0.0:1789127620.408139:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127620.408160:0:3650:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581b85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789615488:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.408776:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581f30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3651:1876035789614080:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.408814:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127620.408846:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581b861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789614592:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.408871:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127620.408890:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581b87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789615104:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.408913:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127620.408931:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581b86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789615616:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.408951:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127620.408986:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581f30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789614208:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.409161:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127620.409182:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581b852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789614720:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.409595:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127620.409616:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581b85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789615232:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.409642:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127620.409657:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9346b62e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789615744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127620.409678:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127620.409700:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789127620.409706:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581b870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789614336:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.409727:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127620.409748:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581b86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789614848:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.409784:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127620.409802:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934581b843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789615360:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.409823:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127620.409925:0:17939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789614080 00000100:00100000:2.0:1789127620.409932:0:17939:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789614080 00000100:00100000:2.0:1789127620.409976:0:17939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789127620.409984:0:17939:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346875e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:3651:x1876035789614080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127620.410289:0:3650:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789127620.410322:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789614464 00000100:00100000:0.0:1789127620.410327:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789614464 00000100:00100000:0.0:1789127620.410362:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789614976 00000100:00100000:0.0:1789127620.410366:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789614976 00000100:00100000:0.0:1789127620.410379:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789614336 00000100:00100000:0.0:1789127620.410381:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789614336 00000100:00100000:0.0:1789127620.410392:0:20028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789614848 00000100:00100000:0.0:1789127620.410394:0:20028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789614848 00000100:00100000:0.0:1789127620.410406:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127620.410412:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581b84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3650:x1876035789614464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.410457:0:17939:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346875e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e+24:3651:x1876035789614080:12345-0@lo:400:kworker.0 Request processed in 473us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127620.410457:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581b84f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3650:x1876035789614464:12345-0@lo:400:kworker.0 Request processed in 44us (2384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127620.410465:0:17939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1789127620.410465:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789127620.410479:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789127620.410484:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789614976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.410494:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789614592 00000100:00100000:2.0:1789127620.410497:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789614592 00000100:00100000:2.0:1789127620.410530:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789615104 00000100:00100000:2.0:1789127620.410533:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789615104 00000100:00100000:0.0:1789127620.410536:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581b87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3650:x1876035789614976:12345-0@lo:400:kworker.0 Request processed in 53us (2397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127620.410543:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789127620.410544:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789615616 00000100:00100000:2.0:1789127620.410546:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789615616 00000100:00100000:0.0:1789127620.410553:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789127620.410557:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789615232 00000100:00100000:0.0:1789127620.410558:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff93458840f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789614336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.410559:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789615232 00000100:00100000:2.0:1789127620.410569:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789615360 00000100:00100000:2.0:1789127620.410572:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789615360 00000100:00100000:2.0:1789127620.410584:0:20455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789615488 00000100:00100000:2.0:1789127620.410586:0:20455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789615488 00000100:00100000:0.0:1789127620.410589:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff93458840f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789614336:12345-0@lo:400:kworker.0 Request processed in 31us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127620.410594:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789127620.410604:0:20028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789127620.410609:0:20028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346904061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789614848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.410612:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789127620.410617:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789614592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789127620.410635:0:20028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346904061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789614848:12345-0@lo:400:kworker.0 Request processed in 26us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127620.410640:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3651:x1876035789614592:12345-0@lo:400:kworker.0 Request processed in 24us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789127620.410640:0:20028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789127620.410646:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789127620.410656:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789127620.410662:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789615104:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789127620.411073:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789127620.411078:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789127620.411080:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789127620.411083:0:17941:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789127620.412653:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3651:x1876035789615104:12345-0@lo:400:kworker.0 Request processed in 1989us (3736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127620.412663:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789127620.412693:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789127620.412703:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789615616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.412731:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3651:x1876035789615616:12345-0@lo:400:kworker.0 Request processed in 32us (3779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127620.412737:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789127620.412748:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127620.412756:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789615232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.412784:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3652:x1876035789615232:12345-0@lo:400:kworker.0 Request processed in 28us (3141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127620.412789:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127620.412800:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789127620.412805:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346929543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789615360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.412834:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346929543c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3652:x1876035789615360:12345-0@lo:400:kworker.0 Request processed in 29us (3010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127620.412840:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789127620.412850:0:20455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789127620.412856:0:20455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934581b84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789615488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.412880:0:20455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934581b84780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3650:x1876035789615488:12345-0@lo:400:kworker.0 Request processed in 25us (2604us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127620.412885:0:20455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789127620.412911:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789614208 00000100:00100000:2.0:1789127620.412917:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789614208 00000100:00100000:2.0:1789127620.412963:0:17951:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789614720 00000100:00100000:2.0:1789127620.412966:0:17951:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789614720 00000100:00100000:2.0:1789127620.412978:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789127620.412983:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789614208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.413015:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3652:x1876035789614208:12345-0@lo:400:kworker.0 Request processed in 32us (3854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127620.413020:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789127620.413030:0:17951:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127620.413035:0:17951:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789614720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.413057:0:17951:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789614720:12345-0@lo:400:kworker.0 Request processed in 23us (3464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127620.413062:0:17951:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789127620.413098:0:19459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789615744 00000100:00100000:2.0:1789127620.413102:0:19459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789615744 00000100:00100000:2.0:1789127620.413124:0:19459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789127620.413130:0:19459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9346b62e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1876035789615744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789127620.413152:0:19459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789127620.413183:0:19459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9346b62e03c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3652:x1876035789615744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (3504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127620.413189:0:19459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789127620.413239:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581f30f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb5dd8f2-4233-4c77-b9d8-bfdb601a306e:3651:1876035789614080:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.413266:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581b861c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3651:1876035789614592:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.413289:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581b87840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3651:1876035789615104:0@lo:400:kworker.0 00010000:00080000:2.0:1789127620.413303:0:3651:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934581b86d00 x1876035789615616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127620.413325:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581b86d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3651:1876035789615616:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.416984:0:3651:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789127620.417006:0:3651:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934587e73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789616000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127620.417075:0:3651:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127620.417128:0:19457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789616000 00000100:00100000:2.0:1789127620.417136:0:19457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789616000 00000100:00100000:2.0:1789127620.417169:0:19457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789127620.417177:0:19457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692955e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789616000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789127620.418818:0:19457:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789127620.418912:0:19457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692955e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3651:x1876035789616000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1732us (1834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789127620.418922:0:19457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789127620.419141:0:3651:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934587e73c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3651:1876035789616000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789127620.434503:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581b870c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789614336:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.434534:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581b86940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789614848:0@lo:400:kworker.0 00010000:00080000:2.0:1789127620.434547:0:3652:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff934581b843c0 x1876035789615360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789127636 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789127620.434556:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581b843c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3652:1876035789615360:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.434566:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581f30780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789614208:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.434576:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581b852c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789614720:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.434586:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581b85e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3652:1876035789615232:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.434606:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9346b62e2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3652:1876035789615744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789127620.434660:0:3652:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789127620.434669:0:3652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff934692923840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789615872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789127620.434723:0:3652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789127620.434775:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581b85a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3650:1876035789614464:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.434783:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581b87c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3650:1876035789614976:0@lo:400:kworker.0 00000100:00100000:2.0:1789127620.434792:0:3650:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934581b85680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3650:1876035789615488:0@lo:400:kworker.0 00000100:00100000:3.0:1789127620.435708:0:19459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876035789615872 00000100:00100000:3.0:1789127620.435716:0:19459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876035789615872 00000100:00100000:3.0:1789127620.435765:0:19459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789127620.435775:0:19459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff934692956d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789615872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789127620.435797:0:19459:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789127620.435856:0:19459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff934692956d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3652:x1876035789615872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789127620.435863:0:19459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789127620.435886:0:3652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff934692923840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3652:1876035789615872:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789127620.599644:0:17933:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789127620.768242:0:21131:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1789127621.623876:0:17934:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 44407 lines, 44407 kept, 0 dropped, 0 bad.